Sensor modules for acceleration, gyro, and magnetic field

I came across 2 Sensor module recently released by ST Microelectronics:

There will be in the future probably very few mobile devices without such sensors. When we worked on the project TEA in 1999 it seemed far away… What can you do with sensors on the mobile? There are a few papers to read: using them for context awareness [1], for interaction [2], [3], and for creating smart devices [4].

Last week in Finland I met Antii Takaluoma (one of the co-authors of [1]) and he works now for offcode.fi – I saw impressive Linux hardware – I expect cool stuff to come 🙂

[1] Schmidt, A., Aidoo, K. A., Takaluoma, A., Tuomela, U., Laerhoven, K. V., and Velde, W. V. 1999. Advanced Interaction in Context. In Proceedings of the 1st international Symposium on Handheld and Ubiquitous Computing (Karlsruhe, Germany, September 27 – 29, 1999). H. Gellersen, Ed. Lecture Notes In Computer Science, vol. 1707. Springer-Verlag, London, 89-101.

[2] Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing techniques for mobile interaction. In Proceedings of the 13th Annual ACM Symposium on User interface Software and Technology (San Diego, California, United States, November 06 – 08, 2000). UIST ’00. ACM, New York, NY, 91-100. DOI= http://doi.acm.org/10.1145/354401.354417

[3] Albrecht Schmidt. Implicit human computer interaction through context. Personal and Ubiquitous Computing, 4(2):191-199, June 2000

[4] A. Schmidt and K. Van Laerhoven. How to Build Smart Appliances?, IEEE Personal Communications, p.66 – 71, (2001)

Doctoral colloquium in Tampere

For the second time we organized an international doctoral colloquium on HCI – mainly with students from Germany and Finland. This year it was hosted at the University of Tampere. 10 students in different stages of their PhD presented their work and ideas. The first one was in Oulu.

Besides many scientific and technological topics we discussed the process of doing a PhD. I shared my experience of doing a PhD based on an extened version of Jakob Badram’s fish model as well as with the PI-presentation model.

The fish: basically you start with a topic and it widens over time – till at some point you have to focus – and when you have focused and found the specific contribution you have to widen again a bit to cover the things you need for making it a coherent PhD-thesis. This applies to the technical skill set of the student as well as to the research topic. Pertti added a personal sanity graph – from the beginning when you think of how difficult a PhD is, to the middle were you think you know it all and everyone else in the research community has no clue, to the (hopefully) final stage where you get a objective view on your PhD (where you realize you made a contribution you can be proud of – but it is probably not going to change the whole world). It seemed that most people who have done a PhD in CS can relate to this graph…

Creativity Workshop at NRC Tampere

Creativity is a key issue of creating novel applications and interaction methods and techniques. Over two days we ran a hands on prototyping workshop on physical user interaction. We setup teams of 3 people, each team including at least one person with design and one with programming skills. Within about 5 hours the teams had to create a multiplayer interactive game – using a mouse or several mice as basic sensors. We discussed how novelty and the learning curve of interaction technologies relate to physical interaction. The results of the workshop were most impressive… and I think some of them could be really pushed further.
In 2008 there was an interesting issue of Interactions Magazine on innovation. The cover article by Dubberly provides a good conceptual models of innovation [1]. In my lecture on HCI I tyically also introduce the TRIZ (“The theory of solving inventor’s problems”) methodology, introduced by the Soviet engineer and researcher Genrich Altshuller. TRIZ is interesting to me, as it is in contrast to many other creativity approaches,a systemtic (algorithmic) approach for generating innovative ideas and solutions for problem solving. However I am not sure how well it works in the real world…
During the workshop our approach was very practical. We did also a speed invention exercise – the task was to create 3 game concepts (related to physical penny games) within 10 minutes. The results were pretty impressive – perhaps someone has the time to implement them.

And being in Finland we got the real sauna experience – inside +79°C and then outside into the snow -23° – this is cool (in the very literal sense!).

[1] Dubberly, H. 2008. Toward a model of innovation. interactions 15, 1 (Jan. 2008), 28-36. DOI= http://doi.acm.org/10.1145/133

Talk at demola, Finnish Ubicomp program

Jari Ikonen from the Finnish Ubicomp program contacted me last week – interestingly because I shared on this blog the information that I will be in Tampere – and it worked out that we met.

He showed and explained me the demola approach. I find this concept of teaching, training and innovation very exciting. In short demola offers space for students to work on challenging problems that are real and creates opportunities opportunities. Basically companies offer tasks/project to works on. Teams of students (potentially from different universities and fields) will work together to solve it as part of their studies – but the students also will own the IPR. I think that creates interesting teams in realistic settings and has probably a great potential for creating start-ups. Perhaps we should look at this model closer and see how we could create something similar…

As always when meeting interesting people time was too short… I gave an ad-hoc talk based on previous slides on “Mobile & Ubiquitous Computing and Beyond: Mobile Communication changed the world – what else do we need?” and we had a short but very interesting discussion.

Finally a simple explanation of social software

Social software and media is getting hugely popular and there are many longer explanations in CSCW and CHI why this works and what are the basic drivers. I saw a t-shirt that explains it in a single picture 🙂

It may over generalize but there is some truth in it – and given the recent figures on the prevalence of ADHA it seems to be a driving business in the future…

More on Embedded Development Tools, Watch to program

In my digital systems design class we have used the eZ430-F2013 development kits – they are cheap (about 20 €) and most students get it working 🙂

I have seen TI has a new development kit which is really interesting: “eZ430-Chronos Wireless Watch Development Tool” – Could be an useful basis for wearable computing projects – perhaps we should get them for the class on pervasive computing next term?

The TI commercial is on youtube:
http://www.youtube.com/watch?v=LDJIBydJvoM

Some years back IBM had a Linux watch as research platform. Gábor Blaskó published some concepts and protoytpes on how to interact with a watch computer, e.g. with strokes [1] or with a string [2].

[1] Gábor Blaskó and Steven Feiner. An Interaction System for Watch Computers Using Tactile Guidance and Bidirectional Segmented Strokes. Proc. 8th IEEE International Symposium on Wearable Computers (ISWC 2004), Arlington, VA, USA, 31 October – 3 November, 2004. pp.120-123.

[2] Gábor Blaskó, Chandra Narayanaswami, Steven Feiner. Prototyping Retractable String-Based Interaction Techniques for Dual-Display Mobile Devices. Proc. ACM Conference on Human Factors in Computing Systems (CHI 2006), Montreal, Québec, Canada, 22 – 27 April, 2006. pp.369-372.

Why do we need to teach children binary coding?

I am very much in favor of teaching children more than one number system (e.g. binary additional to the decimal system). To me this gives children a better understanding of the nature of numbers – I know that this seems not to be widely shared 😉


Now I found a further reason why it essential to know binary codes – How else would you decode this best before date on this chocolate bar if you would not know it!

Talk at Java User Group Meeting in Essen, Embedded Development

This month at the Java User Group meeting some groups of the University presented their research. First I considered to talk about JAVA on mobile phones (e.g. the tutorials we do with teachers on JAVA ME or JAVA on Android) but then decided to talk more about the ubicomp vision and about how I think computing will change and is already changing the world 🙂 My talk “Ubiquitous Computing and Beyond – Mobile Communication changed the world – what else do we need?” was aimed at opening a discussion what will be the challenge after mobile computing is becoming main stream.

One of the questions was: what are useful platforms to start for with embedded development? Here are a few suggestions:

Breakfast reading: tabgible UIs, brands, and user centred design

The current issue interactions (http://interactions.acm.org) features some interesting articles – at least scanning through it and reading some of them prolonged my breakfast today considerably 😉

The cover story gives an already in its title a very interesting definition of tangible interaction (Tangible Interaction = Form + Computing) [1]. Their view is very much from a design perspective, but provides a good introduction to the topic.

The article by Jay Chaeyong Yi on a success story from Korea is a very good case study of how to apply UI research [2]. It shows (1) a comprehensive example of user driven research and (2) the value and importance it contributes to a product/service. Even though the article describes a project from 2005 I find the topic of messaging on phone still exciting and the example of IM vs. SMS can still tell a lot. Personally I am really interested in where messaging on the phone goes – perhaps there is some time next week in Tampere to discuss this.

Not central on user interfaces but still quite interesting is the article on operationalizing brands with Web 2.0 technologies [3]. The example of eBags.com shows interestingly what is currently possible. Thinking and imagine a bit further and considering the opportunities that arise from the web/internet of things (e.g. where you know from the bag how it is used and can communicate this) some real change will be ahead. And some companies are slowly getting to the point of bringing first products that go into this direction (Ali pointed me to http://greengoose.com).

After setting up some IKEA furniture with my daughter (model BENNO as bookshelf for paper backs and not for CD/DVDs) I found Don Norman’s article where he discusses the issue consuming vs. producing or spectator vs. creator quite interesting [4].

[1] Baskinger, M. and Gross, M. 2010. Tangible interaction = form + computing. interactions 17, 1 (Jan. 2010), 6-11. DOI= http://doi.acm.org/10.1145/1649475.1649477

[2] Yi, J. C. 2010. User-research-driven mobile user interface innovation: a success story from Seoul. interactions 17, 1 (Jan. 2010), 48-51. DOI= http://doi.acm.org/10.1145/1649475.1649487

[3] Yohn, D. L. 2010. Operationalizing brands with new technologies. interactions 17, 1 (Jan. 2010), 24-27. DOI= http://doi.acm.org/10.1145/1649475.1649481

[4] Norman, D. A. 2010. The transmedia design challenge: technology that is pleasurable and satisfying. interactions 17, 1 (Jan. 2010), 12-15. DOI= http://doi.acm.org/10.1145/1649475.1649478

Ubiquitous Computing – Ever wondered if we are there yet?

Given the technologies around us I sometimes wonder how close we are to a vision of ubiquitous computing. In this month IEEE Computer Invisible Computing column I had the pleasure to ask this question and share my view on it.

The short answer is: many technologies are ubiquitous but there is a lot more to come. In particular we see that many technologies (public displays, people centric sensing, and personal memory devices) are just around the corner and that they may have a large impact on how we perceive computing. For the long answer have a look at my article: ubiquitous computing – are we there yet? [1]. I have taken over responsibility for the invisible computing column from Bill Schilit who introduced the Invisible Computing column in 2003 [2].

Some years ago in 2006 Yvonne Rogers presented her view on how Ubicomp is going forward [3] contrasting it to Weiser’s Vision of calm computing. In her paper she introduces an alternative agenda that argue that we should engage people by ubicomp technologies rather than to make life easy, convenient and calm. Yvonne’s paper is an interesting starting point for getting students into this topic.

[1] Schmidt, A. 2010. Ubiquitous Computing: Are We There Yet? Computer 43, 2 (Feb. 2010), 95-97. DOI= http://dx.doi.org/10.1109/MC.2010.54

[2] Schilit, B. N. 2003. Mega-Utilities Drive Invisible Technologies. Computer 36, 2 (Feb. 2003), 97-99. DOI= http://dx.doi.org/10.1109/MC.2003.1178056

[3] Yvonne Rogers: Moving on from Weiser’s Vision of Calm Computing: Engaging UbiComp Experiences. Ubicomp 2006: 404-421

Viral Advertising – simple and effective?

Having a professional interest in advertising I really liked the link my colleague Bruno Müller-Clostermann sent to me. I obviously had to try it with my picture 🙂

My hero movie: http://en.tackfilm.se/?id=1265980862962RA40

The example of the personalized video shows that it is intriguing and that it is potentially viral – but I am not sure if it is effective (or did you get what the advert is for?).

In general the concept to make someone a part of an advert is very powerful. At Mensch&Computer 2008 we published a paper that explores this idea in the context of public displays [1]. The public display project was part of a student assignment in a course I gave in Linz.

[1] Johannes Schönböck, Florian König, Gabriele Kotsis, Dominik Gruber, Emre Zaim, Albrecht Schmidt. MirrorBoard – An Interactive Billboard. Mensch und Computer 2008. Lübeck. Oldenbourg Verlag, 2008, p 207-216.

Visit to TU Dortmund: Impressive Demos on Vision and Audio

After several tries we finally managed to travel to Dortmund (half an hour on the S-Train) to visit Gernot A. Fink‘s group at the Technical University Dortmund. Bastian Pfleging did with this group his master thesis before he joined us. The research focus of the group is on signal processing and computer vision. They also follow an experimental approach – building systems that work (which we saw in the demos). In their lab space they have setup a building (basically a house inside a house – impressive!).

I have learned about a new location technology based on passive infrared sensors. The idea is to pick heat emitted from people and combine the output from several sensors to localize the person. The technology is very simple, potentially cheap, and privacy preserving. Sometime back we thought of a project topic using thermal imaging (not really cheap or privacy preserving) for context-awarenes – but so far there was no student who wanted to do it. Perhaps we should try again to find a student.

The other demos were situated in a meeting room that is equipped with several cameras and microphones. It was interesting to see how robust several of the vision prototypes managed to track people in the room and to detect pointing actions. One basic mechanism the use to detect interesting regions in an image is saliency based on different features – and it works well.

The audio demo used two arrays of 8 microphones each; the arrays are nicely integrated in a ceiling panel. Using these signals they can calculate the energy that originates from a certain spatial region in the room. Looking at the complexity of the hardware and software for sound localization it appears not in the far future that this could become ubiquitous. We talked about the work James Scott did on sound localization (snipping on a light switch) – here is the reference [1].

The room is equipped with sensors, lights, switches and a UI panel that are linked over a commercial bus system (KNX). Sometime ago we had a bachelor project in Essen that looked at EnOcean (another home networking technology). We discussed how well these systems are positioned in comparison to web technologies.

I personally think medium term we will move – at least on a control and user interface level – to web protocols. The moment you use web protocols it is so much easier to create user interfaces (e.g. using a Web browser as frontend) and it is simple integrate with existing systems (e.g. facebook). It would be interesting to assess how easy it is to use RESTful services to replicate some of the features of home automation systems. Sounds like an interesting project topic. There is a workshop on the Web of Things at PerCom in Mannheim – I am curious what is coming up there.

[1] James Scott, Boris Dragovic: Audio Location: Accurate Low-Cost Location Sensing. Pervasive Computing: Third International Conference, PERVASIVE 2005, Munich, Germany, May 8-13, 2005. Springer LNCS 3468/2005. pp 1-18. http://dx.doi.org/10.1007/11428572_1

Will it be possible to keep data secret in the future?

At the moment there is an interesting discussion in Germany: should the state buy data (leaked out of a Swiss bank) that give details on people who have not paid their taxes in Germany. I will not add to the political discussion on that as there have been many arguments – some interesting and others funny. I am only amused about a small party that is very much against it. But one has to be fair – this is after all an indicator that democracy works 😉 parties represent the interests of their voters…

I think on a more general scale this incident and similar current cases could be an indicator of a future where everything that is on (electronic) file is likely to become public, given that there is an interest. One hundred years ago it was pretty difficult to steal or copy a few thousand data sets. You would have needed access to the archives for many nights and copying would have taken days. 30 years ago it would have been still hard – e.g. copying stacks of paper on a Xerox or using several large magnetic disks. Over recent years it has become much easier – a memory card is fairly small and a digital camera to copy documents is in many current mobile phones. It seems that if someone has rightful access to data (at a certain point in time) it may proof very hard to keep them from making a copy – may it be by copying the data digitally or by capturing electronically what they see. And hiding a SD-card is much more trivial than a car load of paper.

And as we know technology is progressing – perhaps we will get laws that restrict how small the physical size of a memory device can be 😉 And there is always a party who will lobby for it…

Visiting TU-Berlin and T-Labs

We have a number of student projects that look at novel applications and novel application platforms on mobile phones. As Michael Rohs from T-Labs is also teaching a course on mobile HCI we thought it would be a good opportunity to meet and discuss some application ideas.

I gave a talk in Michael’s lecture discussing the concept of user interfaces beyond the desktop, context as enabling technology, and future applications in mobile, wearable and ubiquitous computing. We had an interesting discussion – and in the end it always comes down to privacy and impact on society. I see this as a very positive development as it shows that the students are not just techies but that they see the bigger picture – and the impact (be it good or bad) they may have with their developments. I mentioned to books that are interesting to read: the transparent society [1] and total recall [2].

In the afternoon we discussed two specific projects. One was an application for informal social while watching TV (based on a set iconic communication elements) that can be used to generate meta data on the program shown. The other is a platform that allows web developers to create distributed mobile applications making use of all the sensors on mobile phones. It is essential a platform an API that provides access to all functions on the phones available in S60 phones over a RESTful API, e.g. you can use a HTTP call to make a photo on someone’s phone. We hope to release some of the software soon.

In the coffee area at T-labs was a printout with the 10+1 innovation principles – could not resist to take a photo 😉 Seems innovation is really trival – just follow the 11 rules and you are there 😉

[1] David Brin. The Transparent Society: Will Technology Force Us to Choose Between Privacy and Freedom. Basic Books. 1999. ISBN-13: 978-0738201443. Amazon-link. Webpage: http://www.davidbrin.com/transparent.htm

[2] Gordon Bell, Jim Gemmell. Total Recall: How the E-Memory Revolution Will Change Everything. Dutton Adult. 2009. ISBN-13: 978-0525951346. Amazon-link. Webpage: http://totalrecallbook.com/

Ephemeral User Interfaces – nothing lasts forever and somethings even shorter

Robustness and durability are typical qualities that we aim for when building interactive prototypes and systems. Tanja and Axel explored what user experience we can create when we deliberately design something in a way that is ephemeral (=not lasting, there is a good German word “vergänglich”). Ephemeral User Interfaces are user interface elements and technologies that are designed to be engaging but fragile [1]. In the prototype that we showed at TEI 2010 in Cambridge the user can interact with soap bubbles to control a computer. Axel has some additional photos on his web page.


There is a short video of the installation on the technology review blog: http://www.technologyreview.com/blog/editors/24729

[1] Sylvester, A., Döring, T., and Schmidt, A. 2010. Liquids, smoke, and soap bubbles: reflections on materials for ephemeral user interfaces. In Proceedings of the Fourth international Conference on Tangible, Embedded, and Embodied interaction(Cambridge, Massachusetts, USA, January 24 – 27, 2010). TEI ’10. ACM, New York, NY, 269-270. DOI= http://doi.acm.org/10.1145/1709886.1709941

AmbiViz Project Presentation at DoCoMo Eurolabs in Munich

In the AmbiViz project we investigate how context information (explicitly or implicitly collected) can be provided to the user. The aim is that the display of context is meaningful to the user but at the same time abstract and privacy preserving. For context collection we integrated the IYOUIT platform as well as an application that runs as an app in facebook. Examples of abstract presentations are implemented for the Nabaztag and for digital picture frames. More details will be available soon in a WIP paper at Percom 2010. Currently we run a longer term study and are already curious about the results.

Recently launched TVs with Web browsing capabilities include special widgets for certain services (e.g. Philips Net TV offers widgets for youtube, ebay, etc.). This is a first step in the market towards the switch-over of traditional TV we discussed some time ago in Seoul. I wonder what other information services may become hype as widgets or Web channels on TVs.

Book chapter on Teaching Beyond the Classroom

Kati Mäkitalo-Siegl, Jan Zottmann, Frederic Kaplan and Frank Fischer organized a workshop that resulted in the book: Classroom of the Future. The book gives a very good overview and is in my view very well suited to run a seminar

We have one chapter in the book that talks about teaching beyond the classroom and outside a typical classroom using pervasive computing technologies [1]. Our chapter includes some of the work on tangible interaction we did in Munich, e.g. [2] and earlier experience where we did a school garden blog (in German only http://www.hcilab.org/albrecht/flachs-web/).

Details about the book and a free preview are available at the publisher’s side. The free preview includes an article on the classroom of the past – which I found quite interesting. If you are interested in our article, drop me a mail and I may find the draft.

[1] Paul Holleis, Albrecht Schmidt, Heiko Drewes, Richard Atterer, Petra Dollinger. Teaching Beyond the Classroom: Pervasive Computing Technologies for the Classroom of the Future. Classroom of the future. SensePublisher 2010, pp 63-85. ISBN:978-9460911026 (book at amazon)

[2] Terrenghi, L., Kranz, M., Holleis, P., and Schmidt, A. 2006. A cube to learn: a tangible user interface for the design of a learning appliance. Personal Ubiquitous Comput. 10, 2-3 (Jan. 2006), 153-158. DOI= http://dx.doi.org/10.1007/s00779-005-0025-8

Multi-touch on Ice

I thought I have seen all possible multi-touch installations 😉 but here is a new one: Ubice installation.

Jonna and her group at NRC in Finland have built a multi-touch wall made from ice (frozen water – they seem to have plenty of it up there).

Even though it is on youtube (http://www.youtube.com/watch?v=bbtrI6GjBsk) we still hope to see a paper on this project – do the user study before it melts 😉

The Interactive Tabletops and Surfaces 2010 conference is this year in Germany in November 2010: http://www.its2010.org/

Energy Harvesting – wireless power?

Since a wireless charger (RCA Airnergy) was announces at CES that harvests energy from wifi signals that are around the topic is everywhere in the (tech) news. It is an exciting prospective to imagine mobile devices that will recharge themselves from the environment they are in. However I am not sure how well harvesting energy from RF will worked in regular environments – not saturated with radio signals.

The topic is really exciting – and in the end people probably do not care much if the energy is harvested from their movement, from light, temperature or RF – as long as it works. There is a introductory article to energy harvesting by Joe Paradiso and Thad Starner [1] which is worthwhile to read.

[1] Joseph A. Paradiso, Thad Starner, “Energy Scavenging for Mobile and Wireless Electronics,” IEEE Pervasive Computing, vol. 4, no. 1, pp. 18-27, Jan.-Mar. 2005, doi:10.1109/MPRV.2005.9

Article on Driving Automotive User Interface Research in IEEE Pervasive

We wrote an article on the automotive user interface conference that took place in Essen in September 2009. In the current issue of the IEEE Pervasive Computing Magazine this paper is published and gives an overview of the conference [1]. We hope our article highlights the key ideas that were presented at the conference.

Abstract. Cars offer an interesting but challenging microcosm for pervasive computing research and, in particular, for interaction with pervasive computing systems. Increasingly, researchers are looking at interactive applications in the car and investigating human-car interaction from a computer science-rather than an ergonomics or mechanical engineering-perspective. This article reports on the International Conference on Automotive User Interfaces and Interactive Vehicular Applications, wherein participants shared presentations on topics such as aesthetics, user interaction and distraction, safety, and driver monitoring.

[1] Albrecht Schmidt, Wolfgang Spiessl, Dagmar Kern, “Driving Automotive User Interface Research,” IEEE Pervasive Computing, vol. 9, no. 1, pp. 85-88, Jan.-Mar. 2010, doi:10.1109/MPRV.2010.3.

Seminar on Pervasive Display Networks in Dagstuhl

From the 4th to the 8th of January we (Nigel Davies, Antonio Krüger, Marc Langheinrich, Martin Strohbach, and I) organized a Seminar on Pervasive Display Networks in Dagstuhl. The timining was less not perfect but we go a really good team together.

Working on the topic we identify an interesting set of dimensions to classify public display, collected a large set of scenarios, and compiled a bibliography as well as a reading list. As soon as the material is publicly available I will post it.

The first time I have been to Dagstuhl was in September 2001 (the seminar was on during 9/11) on Ubiquitous Computing (http://www.vs.inf.ethz.ch/events/dag2001/). This previous seminar really helped to create a vibrant community. Perhaps Pervasive Display Networks will grow in a similar way.

Since then I have been many times to Dagstuhl – but this year I was skiing while there for the first time. There is a small “skiing resort” close by: Erbeskopf

PS: if you rent skis it is always good to remember what skis (e.g. color, make, size, etc.) one got 😉
I learned just taking the next pair of skis is sub-optimal…

Books – Christmas break reading

While travelling I came across two very different books. On one of the airports I came through I came across Superfreakonimics by Levitt and Dubner [1] I had also read their earlier book (Freakonomics) as well as The Undercover Economist from Tim Harford – so I got this one. It is funny to read and I enjoyed most of it. The Geo-Engineering statements in the book received quite some critism on the net. So don’t by it for its discussion on climate ;-). Reading the books it seems one gets a good explanation of certain things in the world (and economics) – not sure if this is really true, but it is great fun to read nevertheless. I particular like the argument why emancipation leads to a lower quality of teaching in schools 🙂

A very different book (also with regard to the price; its more on a library budget than a casual airport buy), but not less interesting, is “Awareness systems” by Panos Markopolous, Boris de Royter and Wendy Mackay [2]. So far I have had only a quick look at the book but this could be the basis for a seminar in a term to come.

[1] Steven D. Levitt, Stephen J. Dubner. Superfreakonomics. 2009. http://freakonomicsbook.com/ ISBN 978-0-7139-9991-4

[2] Markopoulos, Panos; De Ruyter, Boris; Mackay, Wendy (Eds.). Awareness Systems. Advances in Theory, Methodology and Design. 2009, ISBN: 978-1-84882-476-8

PS: I came across another book that takes an extreme – but still to some extent interesting – perspective on the German society. The book is called “Die verblödete Republik” (the republic that went gaga). In some parts I was reminded of the movie “wag the dog” – but the book is much more serious about it – providing a lot of references…

TPC meetings in Atlanta, Palo Alto and Boston

December was filled with travel – twice to the US and several trips in Europe – and for the first time in two years I did not really get around to write my blog…

I am still wondering what technology we require that could make physical meetings less important. Video conference is getting better and I use it a lot – but it still does not facilitate a discussion between 30 or more people well. Besides the work that is in reviewing I really emjoy that part of my job – I find it really exciting to see so much (somehow) novel work in a very short time.

Academics often complain about a lot of travel – but sometimes we need a reality check. Walking around Atlanta airport and seeing the large number of soldiers I felt that I should not complain about my travels… At the same time I asked myself what we will have first: “remote only” wars or “remote only” critical business meeting.

In the first two weeks of December I had the privilege to be the CHI, Pervasive and PerCom program committee meeting. Having seen more than 100 papers being discussed made the effort in reviewing worthwhile. The overview of the field one gets is amazing. And with the insight view I am looking forward to three very interesting conference programs to come in 2010. By the way Geraldine Fitzpatrick (this years paper co-chair at CHI) has move to the Vienna University of Technology.

Besides the PC meetings there was some time to visit labs. In Palo Alto at Nokia Research we were shown a communication appliance that is designed to facilitate remote interaction and communication around a book. Looks interesting and they promised there will be a paper about this soon.

In Boston I went to the new MediaLab building (and met Leah Buechley and Joe Paradiso) – really exciting – research between boxes. Seeing some a Leah’s work motivated again to look more into wearables. If you are curious too, have a look at Lilypad Arduino [1] and at the 2008 CHI paper [2].

[1] Buechley, L. Lilypad Arduino | build something. http://web.media.mit.edu/~leah/LilyPad/build.html

[2] Buechley, L., Eisenberg, M., Catchen, J., and Crockett, A. The Lilypad Arduino: using computational textiles to investigate engagement, aesthetics, and diversity in computer science education. In CHI ’08: Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (New York, NY, USA, 2008), ACM, pp. 423-432.

Enrico Rukzio visits us in Essen, projections everywhere

On Wednesday and Thursday Enrico visited our group in Essen. He gave a part of my lecture on user interface engineering talking about mobile interaction with the real world. He include interesting examples, such as QR-code/NFC/RFID use in Asia, SixthSense project (camera projection system to wear around the neck) and handheld mobile projections. Enrico also explained some of the multi-tag work he does at Lancaster University [1].

In the lecture we talked briefly about future devices and interfaces. I mentioned one example: projection in the large – on building scale. The 3D visualization overplayed on buildings seem impressive – at least when looking at the video. NuFormer (http://www.projectiononbuildings.com/en) has created several interesting projections – but I never have seen one in the real – so far…

Looking at the 6th sense project and on the building projections we wondered how important in may become in the future to make research results in ubicomp/HCI understandable and accessible to a wide audience. Will this replace papers in the future?

[1] Seewoonauth, K., Rukzio, E., Hardy, R., and Holleis, P. 2009. Touch & connect and touch & select: interacting with a computer by touching it with a mobile phone. In Proceedings of the 11th international Conference on Human-Computer interaction with Mobile Devices and Services (Bonn, Germany, September 15 – 18, 2009). MobileHCI ’09. ACM, New York, NY, 1-9. DOI= http://doi.acm.org/10.1145/1613858.1613905

MUM 2009 in Cambridge, no technical solution for privacy

The 8th International Conference on Mobile and Ubiquitous Multimedia (MUM 2009) was held in Cambridge, UK. The conference is fairly specific and had an acceptance rate of about 33% – have a look at the table of content for an overview. Florian Michahelles presented our paper on a design space for ubiquitous product recommendation systems [1]. Our work contributes a comprehensive design space that outlines design options for product recommendation systems using mobile and ubiquitous technologies. We think that over the next years mobile recommendation systems have the potential to change the way we shop in the real world. It probably will be normal to have access in-depth information an price comparison while browsing in physical stores. The idea has been around for a while, e.g. the pocket bargain finder presented at the first ubicomp conference [2]. In Germany we see also a reaction of some electronics stores that asked users NOT to use a phone or camera in the shop.

The keynote on Tuesday morning was by Martin Rieser on the Art of Mobility. He blogs on this topic on http://mobileaudience.blogspot.com/.
The examples he presented in his keynote concentrated on locative and pervasive media. He characterized locative media as media that by social interaction that is linked to a specific place. He raised the awareness that mapping is very important for our perception of the world, using several different subjective maps – I particular liked the map encoding travel times to London . A further interesting examples was a project by Christian Nold: Bio mapping – emotional mapping of journeys. QR or other bar code markers on cloth (large and on the outside) have a potential … I see this now.

In the afternoon was panel on “Security and Privacy: Is it only a matter of time before a massive loss of personal data or identity theft happens on a smart mobile platform?” with David Cleevely, Tim Kindberg, and Derek McAuley. I found the discussion very inspiring but in the end I doubt more and more that technical solutions will solve the problem. I think it is essential to consider the technological, social and legal framework in which we live. If I would need to live in a house that provides absolute safety (without a social and legal framework) it would be probably not a very nice place… hence I think here we need really interdisciplinary research in this domain.

[1] von Reischach, F., Michahelles, F., and Schmidt, A. 2009. The design space of ubiquitous product recommendation systems. In Proceedings of the 8th international Conference on Mobile and Ubiquitous Multimedia (Cambridge, United Kingdom, November 22 – 25, 2009). MUM ’09. ACM, New York, NY, 1-10. DOI= http://doi.acm.org/10.1145/1658550.1658552

[2] Brody, A. B. and Gottsman, E. J. 1999. Pocket Bargain Finder: A Handheld Device for Augmented Commerce. InProceedings of the 1st international Symposium on Handheld and Ubiquitous Computing (Karlsruhe, Germany, September 27 – 29, 1999). H. Gellersen, Ed. Lecture Notes In Computer Science, vol. 1707. Springer-Verlag, London, 44-51.
http://www.springerlink.com/content/jxtd2ybejypr2kfr/

PhD Defense of Elina Vartiainen

Finland is one country in Europe were it seems pretty hard to get to in the morning from Germany or Austria. If you have a meeting before 11 am you have to fly the day before.

I was invited to Helsinki to be opponent (together with Kaisa Väänänen-Vainio-Mattila) for the PhD defense of Elina Vartiainen at Helsinki University of Technology. The first time I came across work she was involved in was at CHI 2006 in Montreal. She worked with Virpi Roto on the Minimap web browser [1]. Last year in a doctoral colloquium in Finland we first discussed some of her work and I was excited to read it in more detail for the PhD exam.

Dissertations in practical areas of computer science that are done in company research labs are at the same time limited and exciting. What can be done is often limited by the company needs but on the other hand it offers the great opportunity to get things out large scale and collect experiences from many users (e.g. you may want to check the ImageExchange project, where the studies were also part of Elina’s dissertation).

I like the finnish system of having a long public defense. We discussed about 3 hours with Elina and I enjoyed it 🙂

There are two general but important issues I think I take away from our discussion:

  1. do question the research process including the steps (e.g. hardware first or applications first), the approach (e.g. human need centred vs. design driven) and the setup of the teams (who is needed to get a successful product? Business, law, design, hardware?).
  2. innovation for web services on a global scale comes not from a single company or small set of highly skilled developers. Creating opportunities for a larger number developers (with skills limited skills, e.g. like web development) will be the key to create all the applications people need all over the world. Having a single instance controlling what can be developed does scale.

Guess what was the first web browser on a mobile device I used on a mobile device? It was an Apple Messagepad – and the browser was PocketWeb developed at TecO in Karlsruhe (where I worked from 1998-2001), see [2] and http://www.teco.edu/pocketweb/

[1] Roto, V., Popescu, A., Koivisto, A., and Vartiainen, E. 2006. Minimap: a web page visualization method for mobile phones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada, April 22 – 27, 2006). R. Grinter, T. Rodden, P. Aoki, E. Cutrell, R. Jeffries, and G. Olson, Eds. CHI ’06. ACM, New York, NY, 35-44. DOI= http://doi.acm.org/10.1145/1124772.1124779

[2] Stefan Gessler and Andreas Kotulla. PDAs as mobile WWW browsers. Proceedings of the Second World Wide Web Conference ’94: Mosaic and the Web. Chicago, Illinois, USA, 1994.

Best Paper at AmI 2009, Visions

Florian Alt presented our work on pervasive advertising, in particular on creating dynamic user profiles in the real world [1]. This research was carried out together with colleagues in marketing and software systems and implemented in one of our course. We are proud that it got named best paper at AmI 2009! Another paper to look at in this context was presented by Jörg Müller; it looked at pervasive advertisement utilizing screens on public phone boxes. The study is amazing in size (20 displays all over Münster, 17 participating shops) and duration (1 year, 24/7) [2]. Even though the results are not completely conclusive it is very interesting to read about the experience of such a large deployment real world in a research context.

This year at AmI included a vision panel with Juan Carlos Augusto, Florian Michahelles, Jörg Müller, Donald Patterson, which I chaired with Norbert Streiz. The main questions for us were: Is there a need for a vision? What are drivers for a new Vision? And what is the value of having a technology vision? The discussion was very diverse touching on various topics. One interesting observation is that many people – including me – see that a mobile personal device (what now is the mobile phone) will stay at the center of a new vision. A further very insightful comment was that we as a community should try to develop more specific visions (e.g. how will education be in 2020, or how will public transport be in 2030) rather than have a Version 2.0 of the overall vision. I think such more specific visions could be valuable to guide research in Ambient Intelligence in the next years.

[1] Florian Alt, Moritz Balz, Stefanie Kristes, Alireza Sahami Shirazi, Julian Mennenöh, Albrecht Schmidt, Hendrik Schröder and Michael Goedicke: Adaptive User Profiles in Pervasive Advertising Environments. Proceedings of the 3rd European Conference on Ambient Intelligence (AmI ’09). Springer Berlin / Heidelberg. Salzburg, Austria 2009.

[2] Jörg Müller, Antonio Krüger: MobiDiC: Context Adaptive Digital Signage with Coupons. Proceedings of the 3rd European Conference on Ambient Intelligence (AmI ’09). Springer Berlin / Heidelberg. Salzburg, Austria 2009.

Keynote by Frits Grotenhuis at AMI-2009

In the opening keynote of AMI 2009 Frits Grotenhuis (who stepped in for Emil Aarts) looked back at the last 10 years ambient intelligence. In his talk he showed a number of examples of devices that Philips created in this time, including iCat, the Entertaible, Ambilight, and medical devices. He discussed briefly the forces in such developments between market-pull and technology-push and it became evident that many products in this domain are more technology push than market-pull.

I liked the reference back to the Electronic Poem at the 1958 Brussels World’s Fair, which must have been at that time an amazing large scale installation (creating “surround sound” with more than 200 speakers).

The update of the vision (title of the keynote was Ambient Intelligence 2.0: Towards Synergetic Prosperity) suggests a model where the human is in the center and the surrounded by the Mind (well being), Community (participation), Body (health), and Environment (responsibility). I found this did not offer many new insights as by now the human centered approach is widely accepted. Looking at the examples it seems that the vision is very much centering on the “rich” world’s problem… perhaps it is really hard to update a vision.