Opening talk at the Social Media for Insurances Symposium

I was invited to Leipzig to talk about social networks and in the context of insurance companies (http://www.versicherungsforen.net/social-media). The main focus of the talk was to show what people currently do in social networks and to speculate why they do it (and  I used a picture of the seven deadly sins as an illustrations…) Additionally I discussed some prototypes of activity recognition and their potential once integrated into social media.

My talk was entitled “500 Freunde (auf Facebook): Wozu noch eine Versicherung?“ – „500 friends (on Facebook) – Is there still need for insurance?“ and discussed how ubiquitous capture and social media may shape the next community [1]. The slides in are in German.

The event was very interesting and I would expect that there is a great potential out there for insurance companies to tap into. Looking back at the original idea of insurance (e.g. old fire insurance communities) or sharing the risk of hail in farming communities can give interesting inspiration for peer-2-peer insurance models. It will be exciting to see if there a new products and services that come out of the “big players” or if new players will come to the game. To me the central issue to address is how to make insurance products more visible – and I think a user centered design approach could be very interesting…

In the future I would expect that finding the right value mix (privacy, price, safety, etc.) will be essential as we argued for other services in [2]. Some years back we wrote in an article about RFID [3] “privacy is sacred but cheap” and the more services we see the more I am convinced that this is more than a slogan. If you can create a service that is of immediate value to the user I would I expect that privacy will be a lesser concern to most? On the other hand if you reduce privacy without any value in exchange there is always an outcry…

[1] “500 Freunde (auf Facebook): Wozu noch eine Versicherung?“ – Ermöglichen allgegenwärtige Aufzeichnungs-technologien und digitale soziale Netze die nächste Solidargemeinschaft? Slides as PDF (in German)
[2] Albrecht Schmidt, Marc Langheinrich, Kristian Kersting, “Perception beyond the Here and Now,” Computer, vol. 44, no. 2, pp. 86-88, Feb. 2011, doi:10.1109/MC.2011.54 (final version at IEEE, free draft version)
[3] Schmidt, A.; Spiekermann, S.; Gershman, A.; Michahelles, F., “Real-World Challenges of Pervasive Computing“, Pervasive Computing, IEEE , vol.5, no.3pp. 91- 93, c3, July-Sept. 2006. 10.1109/MPRV.2006.57

Talk at the University of New Hampshire, Durham

Andrew Kun invited me to give a talk at the Univeristy of New Hampshire in Durham on my way back from CHI. The talk was on “Embedding Interaction – Human Computer Interaction in the Real World”. In the afternoon I got to see interesting projects in the automotive domain as well as an application on a multi-touch table. At CHI we ran a SIG on Automotive User Interfaces [1].

Seeing the implementation of Project54 live was very exciting. I came across the project first at Pervasive 2005 in Munich [2]. This project is an interesting example of how fast research can become deployed on a large scale.

Andrew chairs together with Susanne Boll the 2nd Int. Conf. on Automotive User Interfaces and Interactive Vehicular Applications – check out the call for papers on http://auto-ui.org/! (deadline 2nd of July 2010)

PS: if you ever stay in Durham – here is my favorite hotel: Three Chimneys Inn Durham.

[1] Schmidt, A., Dey, A. K., Kun, A. L., and Spiessl, W. 2010. Automotive user interfaces: human computer interaction in the car. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI EA ’10. ACM, New York, NY, 3177-3180. DOI= http://doi.acm.org/10.1145/1753846.1753949

[2] Laslo Turner and Andrew L. Kun, “Evaluating the Project54 speech user interface,” Third International Conference on Pervasive Computing (Adjunct Proceedings), Munich, Germany, May 8-13, 2005

Invited Talk by Nicolas Villar

Nicolas visited us in Essen to give the opening talk of our German meeting on tangible interaction. In his talk he first showed some examples of the hardware and sensors group at Microsoft research in Cambridge, most notably the SenseCam (which we learned is licensed and will be soon commercially available).

In the main part of the talk Nicolas presented a modular embedded architecture that allows developers to create custom made digital systems with fairly little effort. By integrating physical development (3D printing), functional blocks and software development the approach aims at empowering developers to create entirely new devices. His examples were impressive, e.g. creating a fully functional game console in a few hours.

Assuming that electronics become really small and cheap and that displays can be directly printed I can see that this approach makes a lot of sense – the question is just how long will it take before we rather use a (nowadays) powerful ARM processor, instead of a logic circuit with 10 gates. I would imagine that from a economic perspective it will less than 20 years before this makes sense.

We talked about energy harvesting and hier is a link to a potential interesting component: LTC3108.

Talk at demola, Finnish Ubicomp program

Jari Ikonen from the Finnish Ubicomp program contacted me last week – interestingly because I shared on this blog the information that I will be in Tampere – and it worked out that we met.

He showed and explained me the demola approach. I find this concept of teaching, training and innovation very exciting. In short demola offers space for students to work on challenging problems that are real and creates opportunities opportunities. Basically companies offer tasks/project to works on. Teams of students (potentially from different universities and fields) will work together to solve it as part of their studies – but the students also will own the IPR. I think that creates interesting teams in realistic settings and has probably a great potential for creating start-ups. Perhaps we should look at this model closer and see how we could create something similar…

As always when meeting interesting people time was too short… I gave an ad-hoc talk based on previous slides on “Mobile & Ubiquitous Computing and Beyond: Mobile Communication changed the world – what else do we need?” and we had a short but very interesting discussion.

Talk at Java User Group Meeting in Essen, Embedded Development

This month at the Java User Group meeting some groups of the University presented their research. First I considered to talk about JAVA on mobile phones (e.g. the tutorials we do with teachers on JAVA ME or JAVA on Android) but then decided to talk more about the ubicomp vision and about how I think computing will change and is already changing the world 🙂 My talk “Ubiquitous Computing and Beyond – Mobile Communication changed the world – what else do we need?” was aimed at opening a discussion what will be the challenge after mobile computing is becoming main stream.

One of the questions was: what are useful platforms to start for with embedded development? Here are a few suggestions:

Interaction technologies for display environments

I was invited to give a talk on “Embedded interaction with display environments” to discuss human computer interaction and technology issue for creating interactive display systems. The summer school has very diverse program! and I have enjoyed listening to my colleagues as much as presenting myself 🙂

In the talk I have a (more or less random) selection of technologies for making display environments interactive. There are the obvious vision based approaches (see the talk for the references) but I think there are many interesting approaches that are not yet fully explored. – including spatial audio location [1], eye tracking, and physiological sensors. Sebastian Boring create a focus and context input by combing different input technologies [2] – this can be especially interesting when scaling interaction up to larger surfaces. Additionally I think looking at the floor and the ceiling is worthwhile…

Please feel free to add further technologies and approaches for creating interactive displays in the comment.

[1] James Scott, Boris Dragovic: Audio Location: Accurate Low-Cost Location Sensing. Pervasive Computing: Third International Conference, PERVASIVE 2005, Munich, Germany, May 8-13, 2005. Springer LNCS 3468/2005. pp 1-18. http://dx.doi.org/10.1007/11428572_1

[2] S. Boring, O. Hilliges, A. Butz. A Wall-sized Focus plus Context Display. In Proceedings of the Fifth Annual IEEE Conference on Pervasive Computing and Communications (PerCom), New York, NY, USA, Mar. 2007

Visit to NEC labs in Heidelberg

In the afternoon I gave a talk at NEC labs in Heidelberg on ubiquitous display networks. Over the last year we developed and number of ideas and prototypes of interactive public display systems. We run a lab class (Fallstudien) on pervasive computing technologies and advertising together with colleagues from marketing. In another class (Projektseminar) we investigated how to facilitate interaction between interactive surfaces (e.g. multi touch table) and mobile devices. One of the prototypes will be shown as poster at mobile HCI 2009 in Bonn. In some thesis projects we introduced the notion of mobile contextual displays and their potential applications in advertising, see [1] and [2].

Seeing the work at NEC and based on the discussion I really think there is a great of potential for ubiquitous display networks – at the same time there are many challenges – including privacy that allways ensures discussion 😉 It would be great to have another bachelor or master thesis to address some of them – perhaps jointly with people from NEC. To understand the information needs in a particular display environment (at the University of Duisburg-Essen) we currently run a survey to better understand requirements. If you read German you are welcome to participate in the survey.

Predicting the future usually features in my talks – and interestingly I go a recommendation from Miquel Martin for a book that takes its own angle on that: Predictably Irrational by Dan Ariely (the stack of book gets slowly to large – time for holidays).

[1] Florian Alt, Albrecht Schmidt, Christoph Evers: Mobile Contextual Displays. Pervasive Advertising Workshop @ Pervasive 2009. Nara, Japan 2009.

[2] Florian Alt, Christoph Evers, Albrecht Schmidt: Users’ View on Car Advertisements. In: Proceedings of the Seventh International Conference on Pervasive Computing, Pervasive’09. Springer Berlin / Heidelberg Nara, Japan 2009.

App store of a car manufacturer? Or the future of cars as application platform.

When preparing my talk for the BMW research colloquium I realized once more how much potential there is in the automotive domain (if you looks from am CS perspective). My talk was on the interaction of the driver with the car and the environment and I was assessing the potential of the car as a platform for interactive applications (slides in PDF). Thinking of the car as a mobile terminal that offers transportation is quite exciting…

I showed some of our recent project in the automotive domain:

  • enhance communication in the car; basically studying the effect of a video link between driver and passenger on the driving performance and on the communication
  • handwritten text input; where would you put the input and the output? Input on the steering wheel and visual feedback in the dashboard is a good guess – see [1] for more details.
  • How can you make it easier to interrupt tasks while driving – we have some ideas for minimizing the cost of interruptions for the driver on secondary tasks and explored it with a navigation task.
  • Multimodal interaction and in particular tactile output are interesting – we looked at how to present navigation information using a set of vibra tactile actuators. We will publish more details on this at Pervasive 2009 in a few weeks.

Towards the end of my talk I invited the audience to speculate with me on future scenarios. The starting point was: Imagine you store all the information that goes over the bus systems in the car permanently and you transmit it wireless over the network to a backend storage. Then image 10% of the users are willing to share this information publicly. That is really opening a whole new world of applications. Thinking this a bit further one question is how will the application store of a car manufacturer look in the future? What can you buy online (e.g. fuel efficiency? More power in the engine? A new layout for your dashboard? …). Seems like an interesting thesis topic.

[1] Kern, D., Schmidt, A., Arnsmann, J., Appelmann, T., Pararasasegaran, N., and Piepiera, B. 2009. Writing to your car: handwritten text input while driving. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04 – 09, 2009). CHI EA ’09. ACM, New York, NY, 4705-4710. DOI= http://doi.acm.org/10.1145/1520340.1520724

The next big thing – let’s look into the future

At Nokia Research Center in Tampere I gave a talk with the title “Computing Beyond Ubicomp – Mobile Communication changed the world – what else do we need?“. My main argument is that the next big thing is a device that allows us to predict the future – on a system as well as on a personal level. This is obviously very tricking as we have a free will and hence the future is not completely predictable – but extrapolating from the technologies we see now it seems not farfetched to create a device that enables predictions of the future in various contexts.

My argument goes as follows: the following points are technologically feasible in the near future:

  1. each car, bus, train, truck, …, object is tracked in real-time
  2. each person is tracked (location, activity, …, food intake, eye-gaze) in real-time
  3. environmental conditions are continuously sensed – globally and locally sensed
  4. with have a complete (3D) model of our world (e.g. buildings, street surface, …)

Having this information we can use data mining, learning, statistics, and models (e.g. a physics engine) to predict the future. If you wonder if I forget to thing about privacy – I did not (but it takes longer to explain – in short: the set of people who have a benefit or who do not care is large enough).

Considering this it becomes very clear that in medium term there is a great potential in having control over the access terminal to the virtual world, e.g. a phone… just thing how rich your profile in facebook/xing/linkedin can be if it takes all the information you implicitly generate on the phone into account.

Illusions 2.0, Talk at the Museum Ludwig in Köln

In Cologne in the Museum Ludwig I gave in the afternoon a talk on “Illusions 2.0 – embedded interactive media” at the Forum Mediendesign. The talk focused on the new qualities of magical experiences we will be able to create with pervasive computing technologies in the future and linked this to Alan Kay’s notion of user illusion and metaphors. I looked at trends that are ingredience for creating Illusions 2.0 – in particular ubiquitous communication and display, constant tracking and logging, and the decrease of value of traditional content (text, audio, video, software, tv, statistical data). I highlighted one development that have already happened and has impacted our lives with the following statement. The question “If I only would know when the others come and where they are now…” was common to people born before 1970 but is completely alien to people born after 2000. Mobile communication has changed this and tracking will add more change over the next years.

Based on some examples from recent popular fiction (Harry Potter) I showed that things that we have considered magical are becoming rapidly community products (e.g. marauders map). Spinning this idea forward I asked how far are we with regard to other human dreams such as looking into the future or never forgetting anything we have seen or heard. And the answer in short is: we are close 😉 for more see the slides of my talk on Illusion 2.0. There is an upcoming paper we wrote for IEEE Multimedia Magazine on this topic – will tell as soon as it is published 😉

In the morning I had some time for sightseeing and Vivien and I went to the chocolate museum. The museum is brilliant and I learned how the hollow chocolate santas are made 🙂 In the top floor they have a table top projection for a quiz – it is very well done (as the whole museum) but the technology did not work on the table close to the window. As we know from our experience if you have sun light your camera-projector systems may have trouble 😉
PS: it was interesting that the whole organization was done by students as a course in project management – and they did it really well.

Lucia and Thomas from Vodafone R&D visiting

Lucia Terrenghi and Thomas Lang from Vodafone R&D in Munich visited our lab. We talked at lot about the future role of mobile devices and in particular how they may change personal computing in the near future. 

After lunch they gave a talk for our students describing Vodafone research and their particular research interests. Using a nice visualization of train lines they showed the research themes and introduced some of their research foci. One area of interest is electronic paper, resulting future devices and potential applications and services. In the discussion I briefly mentioned that I had a look at some of the displays with my microscope – have a look in the previous blog post if you are interested.

Ageing, Technology, Products, Services

Today and yesterday I am visiting a conference that is concerned with ageing – looking at the topic from different perspective (computer science, psychology, medicine, economics) run at the MPI in Berlin. The working group is associate with the the German Academy of Sciences Leopoldina and I was invited by Prof. Ulman Lindenberger who is director at the Max Planck Insititut and works in Lifespan Psychology. The working group is called ageing in Germany (in German).

Antonio Krüger and I represented the technology perspective with example from the domain of ubiquitous computing. My talk “ubiquitous computing in adulthood and old age” is a literature review in pictures of selected ubicomp systems targeted as an introduction to non-CS people to the domain. The discussions were really inspiring. In one talk Prof. Jim-Chern Chiou from National Chiao Tung Univeristy in Taiwan (the brain research lab) presented interesting dry electrodes that can be used for EEG – but also for other applications where one need electrodes.

Antonio reported an interesting experiment on the navigation/walking performance of people. The basic message is: if you are old and you can hold on to something while walking you gain cognitive resource – if you are young this effect is not given – has quite interesting impliciations [1]. Antonio worked on more in this domain, see [2].
Over lunch we discussed some ideas related to persuasive technologies and Ulman Lindenberg hinted me some relevant authors (Bargh, Gollwitzer) and I found an interesting manual on subliminal prime on the web.
[1] Martin Lövdén, Michael Schellenbach, Barabra Grossmann-Hutter, Antonio Krüger, Ulman Lindenberger: Environmental topography and postural control demands shape aging-associated decrements in spatial navigation performance. Psychology and Aging, 20, 683-694, 2005 http://www.ncbi.nlm.nih.gov/pubmed/16420142
[2] Aslan, I., Schwalm, M., Baus, J., Krüger, A., and Schwartz, T. 2006. Acquisition of spatial knowledge in location aware mobile pedestrian navigation systems. In Proceedings of the 8th Conference on Human-Computer interaction with Mobile Devices and Services (Helsinki, Finland, September 12 – 15, 2006). MobileHCI ’06, vol. 159. ACM, New York, NY, 105-108. DOI= http://doi.acm.org/10.1145/1152215.1152237

Accessibility Workshop – Implication of ubiquitous computers

In Gelsenkirchen (just 15 minutes on the train) was today a conference on accessibility “Einfach für Alle” (easy for all). http://www.einfach-fuer-alle.de/tagung/

I was invited as an expert in the workshop on business opportunities for the internet of the future and of assistive technologies. The workshop was moderated by Thomas Hänsgen and the other experts were Arthur Ortega (Yahoo!) and Günther Weber (Vodafone). The discussion was very lively and I learned a lot! Some results of the discussion are online at the workshop website.

To start with everyone had the opportunity to give some statements – I had the following: (1) digital assistance will enhance the capabilities for everyone; (2) contextualizing services will increase locale interaction; (3) user generated content will help us to make the real world more accessible. See the slides with topics and examples (in German).

Wolfgang Spießl presented our CHI-Note

People take mobile devices into their cars and the amount of information people have on those devices is huge – just consider the number of songs on an MP3-Player, the address database in a navigation system and eventually the mobile web. In our work we looked at ways to design and implement search interfaces that are usable while driving [1]. For the paper we compared a categorized search and a free search. The was another paper in the session looking at practice of GPS use by Leshed et al. which was really interesting and can inform future navigation or context-aware information systems [2]. One interesting finding is that you loose AND at the same time create opportunities for applications and practices. In the questions she hinted some interesting observations on driving in familiar vs. driving in unfamiliar environments using GPS units. Based on these ideas there may be an interesting student project to do…

The interest in Wolfgang’s talk and into automotive user interfaces in general was unexpected high. As you see on the picture there was quite a set of people talking pictures and videos during the presentation.

[1] Graf, S., Spiessl, W., Schmidt, A., Winter, A., and Rigoll, G. 2008. In-car interaction using search-based user interfaces. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 1685-1688. DOI= http://doi.acm.org/10.1145/1357054.1357317

[2] Leshed, G., Velden, T., Rieger, O., Kot, B., and Sengers, P. 2008. In-car gps navigation: engagement with and disengagement from the environment. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 1675-1684. DOI= http://doi.acm.org/10.1145/1357054.1357316

Application Workshop of KDUbiq in Porto

After having frost and snow yesterday morning in Germany being in Porto (Portugal) is quite a treat. The KDubiq application workshop is in parallel to the summer school and yesterday evening it was interesting to meet up with some people teaching there.

The more I learn about data mining and machine learning the more I see even greater potential in many ubicomp application domains. In my talk “Ubicomp Applications and Beyond – Research Challenges and Visions” I looked back at selected applications and systems that we have developed over the last 10 year (have a look at the slides – I, too was surprised what variety of projects we did in the last years ;-). So far we have often used basic machine learning methods to implement – in many cases creating a version 2 of these systems where machine learning research is brought together with ubicomp research and new technology platforms could make a real difference.

Alessandro Donati from ESA gave a talk “Technology for challenging future space missions” which introduced several challenges. He explained their approach to technology introduction into mission control. The basic idea is that the technology providers create together with the users a new application or tool. He strongly argued for a user centred design and development process. It is interesting to see that the concept of user centred development processes are becoming more widespread and go beyond classical user interfaces into complex system development.

Advertising 2.0 – Presentation at CeBIT

This morning I presented a short talk on new ways for outdoor advertisement at CeBIT. Based on results from interviews we know that shop windows and billboards are a well received medium. Similarly to measures we know from web logfiles I argue that it is interesting to have similar information on visitors, views, returns, durations for real world adverts.

The general approach we suggest is to use senor to measure activity – and as such measurements are incomplete there is need for data analysis and models. In two examples I show how this can be done using Bluetooth as sensing device. The slides (in German) are online.

Paul presented a paper on mobile phone interaction at TEI’08

Paul Holleis presented at TEI’08 the results of the research he did during his internship at Nokia Research [1]. Over the summer Paul spent 3 month with Jonna Häkkila’s group in Helsinki, where he worked on two projects: combing touch and key-presses and wearable controls.

Technically both projects used capacitative sensing to recognize touch. In his paper “Studying Applications for Touch-Enabled Mobile Phone Keypads” [1] they added to common mobile phone buttons touch sensing so that multiple levels of interaction can be measured, such as approaching, touching and pressing. The paper additionally discusses new interaction possibility that arise from this.

[1] Paul Holleis, Jonna Häkkilä, Jussi Huhtala. Studying Applications for Touch-Enabled Mobile Phone Keypads. Proceedings of the 2nd Tangible and Embedded Interaction Conference TEI’08. February 2008.

Visit at the TU Eindhoven

Elise van den Hoven, the program co-chair of TEI08, organized the printing of the proceeding. We went there on Tuesday to collect the books – quite a heavy load! The books look really good and the cover is great.

In the afternoon I gave a lecture with the title “Interacting with Pervasive Computing Systems”. I have related some of our recent work and ideas to the focus of the course which is “intelligent systems, products and related services”. In particular I asked to re-think how we can find a balance between user needs and technology push – without compromising a fruitful user centred design and development process. We continued this discussion with prof. Berry Eggen at dinner in a quite nice restaurant in town.

A further issue in my talk was to design interactive products and services that they fit their purpose very well – but that beyond this they allow for creative use. As an example I showed a set of photos I took with my phone. Some are in categories (e.g. preserving memory) that were probably anticipated by the designers whereas others (e.g. a WIFI-access code with I took a photo of not to have it to write down) are creative use. This observation again leads to the previous discussion on technology push and user need.

Being still new to the Ruhrgebiet and having not brush up on regional geography I was very much surprised how close Eindhoven is to Essen. Perhaps there is a chance for more collaboration in the future.

Learntec – Session on pervasive computing

I was today in Karlsruhe at Learntec, a trade fare and congress for technologies in learning, training and education. Alois Ferscha organized a session on pervasive computing and learning.

My talk was entitled “back to the roots – technologies for interweaving learning and experience”. I stared out with the question: What is the difference between an apple tree and a biology book. In essence my argument is that (1) first hand experience can not be replaced, (2) we need consolidated knowledge based on the experience to learn efficiently, and (3) pervasive computing technologies can bridge the gulf between them.

The slides of the talk “Zurück zum Ursprung – Technologien für die Verflechtung von Lernen und Erfahren” (in German) are available on my web page.

Talk at the expert meeting on RFID and ubicomp

In Frankfurt there was today an expert meeting on RFID and ubicomp organized by the Fraunhofer ISI. The purpose was a discussion about the impact of RFID technologies. The organizers will use our input to inform the creation of a document of technology assessment for the German parliament. The majority of the participants came from companies developing RFID technology or system.
In the first part of my talk “RFID and Beyond” I highlighted results from two workshops where I was a co-organizer: PTA2006 and Pertec2007 held at the Pervasive and Percom conferences. The results were also published in 2 papers in the IEEE Pervasive Computing magazine, see [1] and [2]. After this I showed some future visions and scenarios, namely the Smart-Its & MediaCup (foto from Birgit at Teco) [3], the SensorKnife [4], and the aware goods project [5]. Michael Müller extended the idea of the first aware goods project with a mobile phone based prototype – which we still have not written up for publication.

For me the technology assessment in Germany seems still often very much centred on threats and looks much less at opportunities. Looking at developments in Asia and in particular in Korea (e.g. U-City) I hope politics in Germany will in the future more often see the positive sides, too. Technology assessment can become a means to find opportunities and ideas to support innovation. For me it seems that a lot of the risks people attribute to RFID are not based on scientific results – is appears rather media induced… Positive cases such as wireless key systems and transport tickets (basically RFID technology) are in widespread use without much problems and great value for users – but not present in the public discussion.

One interesting estimated was that about 200 parts of the several thousands (e.g. safety related parts, large parts, parts that are often stolen, expensive parts) per car will tagged with RFID in the next 10 years to ease logistics, production and maintenance.

[1] Schmidt, A.; Spiekermann, S.; Gershman, A.; Michahelles, F., “Real-World Challenges of Pervasive Computing“, Pervasive Computing, IEEE , vol.5, no.3pp. 91- 93, c3, July-Sept. 2006.

[2] Michahelles, F.; Thiesse, F.; Schmidt, A.; Williams, J. R.: Pervasive RFID and Near Field Communication Technology. In: IEEE Pervasive Computing, vol. 6, no. 3, pp. 94-96, c3, Jul., 2007.

[3] Hans-Werner Gellersen, Albrecht Schmidt, Michael Beigl: Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts. MONET 7(5): 341-351 (2002)

[4] Matthias Kranz, Albrecht Schmidt, Alexis Maldonado, Radu Bogdan Rusu, Michael Beetz, Benedikt Hörnler, Gerhard Rigoll: Context-aware kitchen utilities. Tangible and Embedded Interaction 2007: 213-214

[5] Anke Thede, Albrecht Schmidt, Christian Merz: Integration of Goods Delivery Supervision into E-commerce Supply Chain. WELCOM 2001: 206-218

Talk at the opening of the Fraunhofer IAO interaction lab

The Fraunhofer institute IAO opened today a new interaction lab in Stuttgart under the topic interaction with all senses. Prof. Spath, director of the Fraunhofer IAO, made a strong argument for new user interfaces. In his talk he discussed adaptive cruse control in cars as an example for user interface challenges.

My talk on “implicit interaction – smart living in smart environments” argues for a sensible mix of user centred design and technology driven innovation. As one example I used the Sensor-Knife which Matthias Kranz implemented.

Prof. Jürgen Ziegler, a colleague at the University of Duisburg-Essen who was previously at IAO, showed in his talk a short video of a “galvanic vestibular stimulation” GVS explored by NTT (SIGGRAPH 2005 Demo) to highlight trends and indicate at the same time ethical problems that can arise when we interfere with human senses.

Visit at the University of Hamburg

Yesterday we visited the computer science department at the University of Hamburg. Prof. Oberquelle und Beckhaus had invited me at the Mensch & Computer conference to visit them and give a talk about our work.

Before the seminar we had a chance to see the lab of Steffi Beckhaus. I have tried the ChairIO – and it was fun. They sound floor creates a really interesting experience (similar to the butt-kicker just more intense). We could also play with GranulatSynthese and try the smell user interface (apple smell is absolutely convincing, not sure about some of the others).

We had some discussion on emotions and capturing physiological parameters. Thinking about emotions and senses with regard to a community sharing them opens up a lot of potential for new experiences and potentially applications. We discussed this topic to some extent some weeks ago at the Human Computer Confluence Workshop in Brussels. I really thing a small scale experience in share emotions could move us forward and provide some more insight. In Hamburg they have the NeXus-system (perhaps we should get this too and create a networked application).

In my talk (creating novel user interfaces) I focused on the PhD work of Paul Holleis (KLM for mobile phones, his CHI Paper from last year) and of Heiko Drewes (Eye-Gestures, his Interact’07 paper). The discussion was quite interesting.

World Champion visiting IAIS

Sven Behnke, who won with his humanoid robots the RoboCup, visited us today at Fraunhofer IAIS. In his talk he presented the RoboCup vision – wining in 2050 with humanoid robots against the human world champions and his work towards this goal. There are interesting videos of the robots at http://www.nimbro.net

When I saw Sven presenting the first time (in 2003 at the DFG final round for the “Aktionsplan Informatik”) I was convinced that humanoid robots are far in the future and that the robocup vision is more wishful thinking than vision. Seeing how much it advanced over the last 4 years I am really curious if it will take till 2050.

In his group there is also some interesting work on human-robot interaction. For more see: http://www.informatik.uni-freiburg.de/hr/

Visit to the Wearable Computing Lab at ETH Zurich

I was at ETH Zurich for the PhD defence of Nagendra Bhargava Bharatula. His thesis is on context-aware wearable nodes and in particular on the trade-offs in design and the design space of these devices.

The tour in Prof. Tröster’s lab was very impressive. It is a very active and probably one of the largest groups world wide doing research in wearable computing. It seams that wearable computing is getting more real, many scenarios and demonstrators are much more realistic and useful than several years ago.

In the backmanager project Corinne Mattmann works on a shirt that measures body posture. Using stretch sensors made of elastic threads, which are fixed with silicon to the fabric they can measure several different body postures. The material is really interesting (probably done by http://www.empa.ch/) and I think such technologies will open up many new opportunities. (further reading: Design Concept of Clothing Recognizing Back Postures; C. Mattmann, G. Tröster; Proc. 3rd IEEE-EMBS International Summer School and Symposium on Medical Devices and Biosensors (ISSS-MDBS 2006), Boston, September 4-6, 2006)

The SEAT project (Smart tEchnologies for stress free Air Travel) looks into integration of sensing into a airplane seat set-up. Having seats is a real set-up allows easy testing of ideas and realistic testing in early phases of the project. This setup made me think again more about an automotive setup in my next lab.

Visit at the Institute for Geoinformatics in Münster


Yesterday we had the opportunity to see a set of research demos at the lab of Antonio Krüger at the University of Münster. We had some time to discuss research projects and in the afternoon Nigel and I gave a talk at the Geoinformatics seminar.

We saw exciting work in progress – a nearly ready large scale multi-touch display based on frustrated total internal reflection – according to Antonio the world-largest at the moment. The principle of operation of such a display is very appealing and the demo was convincing. For a comprehensive introduction on the topic see Jef Han’s UIST 2005 technote “Low-cost multi-touch sensing through frustrated total internal reflectionhttp://doi.acm.org/10.1145/1095034.1095054) . I really think we should build one, too (obviously a bit bigger than Antonio’s 😉

Lecture at CDTM in Munich

The CDTM is a joint elite study program from LMU Munich and TU Munich (http://www.cdtm.de/). It offers a set of complementary course for students from different backgrounds including math, business studies, engineering, computer science and media informatics. In their course on multimodal HCI I gave today an introductory lecture on the motivation for and the basics of user interface engineering.

In the seminar room was a real typewrite – in fact a travel type write. It was a real good prop to discuss micro- and macro-efficiency.

One question about the sustainability of a competitive advantage based on user interfaces made me really think. As the user interface is visible it is really hard to protect the competitive advantage and IPR are difficult on this topic. Desktop GUIs are a good example how quickly ideas propagate between competing systems. The only real option to maintain a competitive advantage is to continuously innovate – keeping the status quo means falling behind. The fact that one can not keep new user interface concepts secret (if one includes them in a product) is one of the most exciting aspects of user interfaces research – it is fast moving because everyone shows off their results!

Our Presentations at CHI’07 in San Jose

At this years CHI the Conference on Human Factors in Computing Systems we presented 3 contributions: a full paper, a CHI-note, and a work in progress paper. Have a look at them!

Holleis, P., Otto, F., Hussmann, H., and Schmidt, A. 2007. Keystroke-level model for advanced mobile phone interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1505-1514. DOI= http://doi.acm.org/10.1145/1240624.1240851

Atterer, R. and Schmidt, A. 2007. Tracking the interaction of users with AJAX applications for usability testing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 1347-1350. DOI= http://doi.acm.org/10.1145/1240624.1240828

Holleis, P., Kern, D., and Schmidt, A. 2007. Integrating user performance time models in the design of tangible UIs. In CHI ’07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA, April 28 – May 03, 2007). CHI ’07. ACM Press, New York, NY, 2423-2428. DOI= http://doi.acm.org/10.1145/1240866.1241018

CeBIT: Context-Awareness for Novel Transport and Logistics Services

At the Fraunhofer Forum at CeBIT I had the chance to talk about future transport solutions. One of my students in Munich (Michael Müller) is working on a pro-active transport container. In the project aware-goods (http://www.comp.lancs.ac.uk/~albrecht/awaregoods/) we looked into this domain already in 2000 at TecO together with SAP Research. Reiterating over the idea is really interesting as now the technology is really here – sensor network nodes are available, mobile phones offer massive processing power, there is ubiquitous data connectivity, and web service interfaces are available for many applications.

The big question is now on algorithms and software for context recognition and data mining in the collected sensor data, the integration with processes and company software systems, and the exploitation for optimising transport and logistics processes.