More on Embedded Development Tools, Watch to program

In my digital systems design class we have used the eZ430-F2013 development kits – they are cheap (about 20 €) and most students get it working 🙂

I have seen TI has a new development kit which is really interesting: “eZ430-Chronos Wireless Watch Development Tool” – Could be an useful basis for wearable computing projects – perhaps we should get them for the class on pervasive computing next term?

The TI commercial is on youtube:
http://www.youtube.com/watch?v=LDJIBydJvoM

Some years back IBM had a Linux watch as research platform. Gábor Blaskó published some concepts and protoytpes on how to interact with a watch computer, e.g. with strokes [1] or with a string [2].

[1] Gábor BlaskĂł and Steven Feiner. An Interaction System for Watch Computers Using Tactile Guidance and Bidirectional Segmented Strokes. Proc. 8th IEEE International Symposium on Wearable Computers (ISWC 2004), Arlington, VA, USA, 31 October – 3 November, 2004. pp.120-123.

[2] Gábor BlaskĂł, Chandra Narayanaswami, Steven Feiner. Prototyping Retractable String-Based Interaction Techniques for Dual-Display Mobile Devices. Proc. ACM Conference on Human Factors in Computing Systems (CHI 2006), Montreal, QuĂ©bec, Canada, 22 – 27 April, 2006. pp.369-372.

TPC meetings in Atlanta, Palo Alto and Boston

December was filled with travel – twice to the US and several trips in Europe – and for the first time in two years I did not really get around to write my blog…

I am still wondering what technology we require that could make physical meetings less important. Video conference is getting better and I use it a lot – but it still does not facilitate a discussion between 30 or more people well. Besides the work that is in reviewing I really emjoy that part of my job – I find it really exciting to see so much (somehow) novel work in a very short time.

Academics often complain about a lot of travel – but sometimes we need a reality check. Walking around Atlanta airport and seeing the large number of soldiers I felt that I should not complain about my travels… At the same time I asked myself what we will have first: “remote only” wars or “remote only” critical business meeting.

In the first two weeks of December I had the privilege to be the CHI, Pervasive and PerCom program committee meeting. Having seen more than 100 papers being discussed made the effort in reviewing worthwhile. The overview of the field one gets is amazing. And with the insight view I am looking forward to three very interesting conference programs to come in 2010. By the way Geraldine Fitzpatrick (this years paper co-chair at CHI) has move to the Vienna University of Technology.

Besides the PC meetings there was some time to visit labs. In Palo Alto at Nokia Research we were shown a communication appliance that is designed to facilitate remote interaction and communication around a book. Looks interesting and they promised there will be a paper about this soon.

In Boston I went to the new MediaLab building (and met Leah Buechley and Joe Paradiso) – really exciting – research between boxes. Seeing some a Leah’s work motivated again to look more into wearables. If you are curious too, have a look at Lilypad Arduino [1] and at the 2008 CHI paper [2].

[1] Buechley, L. Lilypad Arduino | build something. http://web.media.mit.edu/~leah/LilyPad/build.html

[2] Buechley, L., Eisenberg, M., Catchen, J., and Crockett, A. The Lilypad Arduino: using computational textiles to investigate engagement, aesthetics, and diversity in computer science education. In CHI ’08: Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (New York, NY, USA, 2008), ACM, pp. 423-432.

Ubicomp Spring School in Nottingham – Tutorial

The ubicomp spring school in Nottingham had an interesting set of lectures and practical sessions, including a talk by Turing Award winner Robin Milner on a theoretical approach to ubicomp. When I arrived on Tuesday I had the chance to see Chris Baber‘s tutorial on wearable computing. He provided really good examples of wearable computing and its distinct qualities (also in relation to wearable use of mobile phones). One example that captures a lot about wearable computing is an adaptive bra. The bra one example of a class of interesting future garments. The basic idea is that these garments detects the activity and changes their properties accordingly. A different example in this class is a shirt/jacket/pullover/trouser that can change its insulation properties (e.g. by storing and releasing air) according to the external temperature and the users body temperature.

My tutorial was on user interface engineering and I discussed: what is different in creating ubicomp UIs compared to traditional user interfaces. I showed some trends (including technologies as well as a new view on privacy) that open the design space for new user interfaces. Furthermore we discussed the idea about creating magical experiences in the world and the dilemma of user creativity and user needs.

There were about 100 people the spring school from around the UK – it is really exciting how much research in ubicomp (and somehow in the tradition of equator) is going on in the UK.

Paul Holleis presented our paper on Wearable Controls

Last year Paul did an internship a Nokia in Finland. He worked there on the integration of capacitive sensors in phones and clothing. After Paul was back we jointly followed up on the topic which resulted in an interesting set of guidelines for placing wearable controls [1].

The paper gives a good overview of wearable computing and interaction with wearable computers. In the work we focused on integrating touch sensitive controls into garments and accessories for a operating the music player integrated in a phone. The study showed that there are prime locations where to place controls on their body: the right hip and above the right knee (for more details see the paper [1]). It furthermore showed that it is not clear expectations of functions (e.g. forward, backward, volume up/down) with regard to controls laid out on the close.

During his internship he also did research on integrating touch into buttons, which was published at Tangible and Embedded Interaction 2008 [2].

[1] Holleis, P., Schmidt, A., Paasovaara, S., Puikkonen, A., and Häkkilä, J. 2008. Evaluating capacitive touch input on clothes. In Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services (Amsterdam, The Netherlands, September 02 – 05, 2008). MobileHCI ’08. ACM, New York, NY, 81-90. DOI= http://doi.acm.org/10.1145/1409240.1409250

[2] Paul Holleis, Jonna Häkkilä, Jussi Huhtala. Studying Applications for Touch-Enabled Mobile Phone Keypads. Proceedings of the 2nd Tangible and Embedded Interaction Conference TEI’08. February 2008.

Keynote at Pervasive 2008: Mark Billinghurst

Mark Billinghurst presented an interesting history of augmented reality and he showed clearly that camera phones are the platform to look out for. He reminded us that currently the 3D performance of mobile phones is similar to the most powerful 3D graphics cards show 15 years ago at SIGGRAPH. Looking back at Steven Feiner’s backpack [1] – the first augmented reality system I saw – can tell us that we should not be afraid to create prototypes that may be a bit clumsy if they allow us to create a certain user experience and for exploring technology challenges.

In an example video Mark showed how they have integrated sensor information (using particle computers) into an augmented reality application. Especially for sensor-network applications this seems to create interesting user interface options.

One reference on to robust outdoor tracking done at Cambridge University [2] outlines interestingly how combining different methods (in this case GPS, inertial, computer vision and models) can move location techniques forward. This example shows that high precision tracking on mobile devices may not be far in the future. For our application led research this is motivating and should push us to be more daring with what we assume from future location systems.

Mark argue to look more for the value of experience – the idea is basically that selling a user experience is of higher value than selling a service or a technology. This view is at the moment quite common – we have seen this argument a lot at CHI2008, too. What I liked with Mark’s argument very much is that he sees it in a layered approach! Experience is at the top of a set of layers – but you cannot sell experience without having technology or services and it seems a lot of people forget this. In short – no experience design if you do not have a technology working. This is important to understand. He included an example of interactive advertisement (http://www.reactrix.com/) which is interesting as it relates to some of the work we do on interactive advertisement (there will more as soon as we have published our Mensch und Computer 2008 paper).

His further example on experience was why you value a coffee at Starbucks at 3€ (because of the overall experience) reminded me of a book I recently read – quite a good airline/park read (probably only if you are not an economist) – makes the world a bit understandable [3].
Build enabling technologies and toolkits as means to improve one’s citation count was one of Mark’s recommendations. Looking back at our own work as well as the work of the Pervasive/Ubicomp community there is a lot of room for improvement – but it is really hard to do it …

[1] S. Feiner, B. MacIntyre, T. Höllerer, and T. Webster, A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Proc. ISWC ’97 (First IEEE Int. Symp. on Wearable Computers), October 13-14, 1997, Cambridge, MA. Also in Personal Technologies, 1(4), 1997, pp. 208-217, http://www1.cs.columbia.edu/graphics/publications/iswc97.pdf, http://www1.cs.columbia.edu/graphics/projects/mars/touring.html

[2] Reitmayr, G., and Drummond, T. 2006. Going out: Robust model-based tracking for outdoor augmented reality. In Proceedings of IEEE ISMAR’06, 109–118.http://mi.eng.cam.ac.uk/~gr281/docs/ReitmayrIsmar06GoingOut.pdf, http://mi.eng.cam.ac.uk/~gr281/outdoortracking.html

[3] Book: Tim Harford. The Undercover Economist. 2007. (German Version: Ă–konomics: Warum die Reichen reich sind und die Armen arm und Sie nie einen gĂĽnstigen Gebrauchtwagen bekommen. 2006.)

Information inside the cap

Travelling on the train from Crailsheim to NĂĽrnberg I saw several police officers on their travels back from an assignment at Stuttgarter Volksfest. When we got off the train the collected their caps from the luggage rack and observed an interesting (traditional) information display.

Inside the cap they carried a schedule and a description of the location they had to go. The size of the paper-display was about 15 x 15 cm. It seems an interesting place to display and access information – perhaps we will do a digital version of the cap as an assignment in our courses.

Ubiquitous, Pervasive and Ambient Computing – Clarification of Terms

In the resent month the question about ubiquitous, pervasive, ambient computing came up several times. An email by Jos Van Esbroeck motivated me to write my view on it…

Clarifying the terms seems an ongoing process as various communities and individuals use each of those terms for new things they are doing.

For me the best way to discriminate the terms ubiquitous computing, pervasive computing, and ambient intelligence is by their origin, history and research communities.

The first term (ubiquitous computing, ubicomp) is linked to Mark Weiser and his vision of computing in the 21st century [1]. In the research community its is very much connected to ubiquitous and pervasive systems that have the user somewhere in the loop. The ubicomp conference [2] seems more focused on user experience than on pure technology.

Pervasive Computing was pushed in the mid 1990s, more by industry and in particular by IBM. Pervasive computing seems from its origin more focused on technologies and solutions than on a particular vision. The two major conferences related to this topic: pervasive [3] and percom [4] are more systems and network focused, however always keeping some attention to the user experience perspective. Here, in particular with percom, many in the research community have their origin in the networking and distributed systems world. To me pervasive computing seems more technical than ubiquitous computing and includes systems that do no have direct human users involved.

The term ambient intelligence was introduced by the European funding agencies in the Framework 5 vision. Around the same time as the Philips Home-lab that drives the term, too. Here, similar to ubicomp, the vision of a new quality of user experience is a driving factor. The research that falls under this label by now is broad and I think it is very similar to the research in ubiquious computing. There is also a European conference on ambient intelligence [5].

Many people that are involved in ubicomp/pervasive/percom are also active in one more traditional research community. In particular many people are additionally involved in user interface research (e.g. CHI-Community), mobile computing and mobile systems, networking and distributed systems.

A very early topic related to the whole field is context-awareness as introduced by Schilit [6] who was working with Weiser. In my PhD dissertation I have looked more into the relationship between ubicomp and context-awareness – it has the title Ubiquitous Computing – Computing in Context [7]

In parallel subtopic in the above field have emerged that look at specific aspects, e.g. internet of things [8] (not necessarily a human in the loop), wearable computing (computing in cloth), smart environments (computing in buildings and furniture), tangible and embedded interaction [9] (looking at the interaction side), smart objects, … and probably many more.

There is also an interesting trend that many of the topics, if they are a bit matured, move back into the traditional communities.

[1] Mark Weiser. The Computer for the Twenty-First Century. Scientific American 265, 3 (September 1991), 94-104
[2] http://www.ubicomp.org/
[3] http://pervasive2008.org/
[4] http://www.percom.org/
[5] http://www.ami-07.org/
[6] B. Schilit, N. Adams, and R. Want. (1994). “Context-aware computing applications“. IEEE Workshop on Mobile Computing Systems and Applications (WMCSA’94), Santa Cruz, CA, US: 89-101 .
[7] Albrecht Schmidt(2003). “Ubiquitous Computing – Computing in Context“. PhD dissertation, Lancaster Univeristy.
[8] http://
www.internetofthings-2008.org
[9] http://www.tei-conf.org/

Visit to the Wearable Computing Lab at ETH Zurich

I was at ETH Zurich for the PhD defence of Nagendra Bhargava Bharatula. His thesis is on context-aware wearable nodes and in particular on the trade-offs in design and the design space of these devices.

The tour in Prof. Tröster’s lab was very impressive. It is a very active and probably one of the largest groups world wide doing research in wearable computing. It seams that wearable computing is getting more real, many scenarios and demonstrators are much more realistic and useful than several years ago.

In the backmanager project Corinne Mattmann works on a shirt that measures body posture. Using stretch sensors made of elastic threads, which are fixed with silicon to the fabric they can measure several different body postures. The material is really interesting (probably done by http://www.empa.ch/) and I think such technologies will open up many new opportunities. (further reading: Design Concept of Clothing Recognizing Back Postures; C. Mattmann, G. Tröster; Proc. 3rd IEEE-EMBS International Summer School and Symposium on Medical Devices and Biosensors (ISSS-MDBS 2006), Boston, September 4-6, 2006)

The SEAT project (Smart tEchnologies for stress free Air Travel) looks into integration of sensing into a airplane seat set-up. Having seats is a real set-up allows easy testing of ideas and realistic testing in early phases of the project. This setup made me think again more about an automotive setup in my next lab.