Congratulations to Frau Doktor Dagmar Kern for a great PhD defense (No. 5)

Dagmar Kern has successfully defended her PhD on “Supporting the Development Process of Multimodal and Natural Automotive User Interfaces” in Essen. External examiner was Antonio Krüger from University of Saarbrücken. Her dissertation will be available online soon. The core contribution of the thesis is the investigation of how to improve a user centered design process for automotive user interfaces. In order to systematically assess user interface designs in cars she developed a design space (inspired by Card et al [5]). In various cases studies she create novel in-car user interfaces and explored experimentally the implications on driver distraction.

Dagmar started working with me as a student of Media Informatics at the LMU Munich in 2005, then jointed my group at Fraunhofer IAIS/BIT in Bonn and move in 2007 with the group to Essen. She was for a short research stay in Saarbrücken and Milton Keynes and was extremely productive over the last years – 18 publications she co-authored are listed in DBLP and here are some highlights of here research:

  • exploration of how to present navigation information (e.g. vibra tactile steering wheel) [1]
  • gazemarks – an approach to aid attention switching between the road and an in car display using eye gaze date [2]
  • a multi-touch steering wheel, that reduced driver distraction [3]
  • a design space for automotive user interfaces [4]

Additionally to the publications one of the side products of here thesis is the CARS open source driving simulator. It is a configurable low cost simulator that can be used to measure driver distraction, e.g. as an alternative to LCT.

Dagmar’s defense brought us back to Essen and it was great to meet many colleagues again. We finally managed to have a group photo taken with nearly all the team (Elba is missing in the Photo).

The doctoral hat may look strange to non-Germans but it has some funny tradition. It is hand crafted by the colleagues and each of the items on the hat tells a story – usually known to the group but in the best case hard to guess for outsiders. Besides others Dagmar’s hat included a scrap heap of cars, a giraffe, a personal vibration device, a yoyo, a railway station building side, and a steering wheel cover.

[1] Dagmar Kern, Paul Marshall, Eva Hornecker, Yvonne Rogers, and Albrecht Schmidt. 2009. Enhancing Navigation Information with Tactile Output Embedded into the Steering Wheel. InProceedings of the 7th International Conference on Pervasive Computing (Pervasive ’09). Springer-Verlag, Berlin, Heidelberg, 42-58. DOI=10.1007/978-3-642-01516-8_5 (free PDF)

[2] Dagmar Kern, Paul Marshall, and Albrecht Schmidt. 2010. Gazemarks: gaze-based visual placeholders to ease attention switching. In Proceedings of the 28th international conference on Human factors in computing systems (CHI ’10). ACM, New York, NY, USA, 2093-2102. DOI=10.1145/1753326.1753646 (free PDF)

[3] Tanja Döring, Dagmar Kern, Paul Marshall, Max Pfeiffer, Johannes Schöning, Volker Gruhn, and Albrecht Schmidt. 2011. Gestural interaction on the steering wheel: reducing the visual demand. In Proceedings of the 2011 annual conference on Human factors in computing systems (CHI ’11). ACM, New York, NY, USA, 483-492. DOI=10.1145/1978942.1979010 (free PDF)

[4] Dagmar Kern and Albrecht Schmidt. 2009. Design space for driver-based automotive user interfaces. In Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’09). ACM, New York, NY, USA, 3-10. DOI=10.1145/1620509.1620511 (free PDF)

[5] Stuart K. Card, Jock D. Mackinlay, and George G. Robertson. 1991. A morphological analysis of the design space of input devices. ACM Trans. Inf. Syst. 9, 2 (April 1991), 99-122. DOI=10.1145/123078.128726

Auto-UI 2012 in the US, looking for hosts for 2013

The next and 4rd international conference on Automotive User Interfaces and Vehicular Applications (AutoUI 2012) will be in Portsmouth, New Hampshire in the USA. The dates for the conference are 17-19 of October 2012. The first day for workshops and tutorials and 2 days for the main conference. Portsmouth is about an 1 hour drive from Boston and the timing is great (fall foliage – the photos of the colorful forests looked good 😉

The steering committee (sc@auto-ui.org) is inviting proposals for Auto-UI 2013 from the community of researchers in the field. The conference was 2009 in Essen (Germany), 2010 in Pittsburgh (USA), 2011 in Salzburg (Austria), and it will be in 2012 in Portsmouth (USA). Keeping this cycle between Europe and North America 2013 should be in Europe.

Paper and demo in Salzburg at Auto-UI-2011

At the automotive user interface conference in Salzburg we presented some of our research. Salzburg is a really nice place and Manfred and his team did a great job organizing the conference!

Based on the Bachelor Thesis of Stefan Schneegaß and some follow-up work we published a full paper [1] that describes a KLM-Model for the car and a prototyping tools that makes use of the model. In the model we look at the specific needs in the car, model rotary controllers, and cater for the limited attention while driving. The prototyping tool provides means to quickly estimate interaction times. It supports visual prototyping using images of the UI and tangible prototyping using Nic Villar´s VoodooIO. Looking forward to having Stefan on our team full-time 🙂

We additionally had a demo on a recently completed thesis by Michael Kienast. Here we looked at how speech and gestures can be combined for controlling functions, such as mirror adjustments or windscreen wipers, in the car. This multimodal approach combines the strength of gestural interaction and speech interaction [2].

The evening event of the conference was at Festung Hohensalzburg – with a magnificent view over the twon!

[1] Stefan Schneegaß, Bastian Pfleging, Dagmar Kern, Albrecht Schmidt. Support for modeling interaction with in-vehicle interfaces. (PDF) Proceedings of 3rd international conference on Automotive User Interfaces and Vehicular Applications 2011 (http://auto-ui.org). Salzburg. 30.11-2.12.2011

[2] Bastian Pfleging, Michael Kienast, Albrecht Schmidt. DEMO: A Multimodal Interaction Style Combining Speech and Touch Interaction in Automotive Environments. Adjunct proceedings of 3rd international conference on Automotive User Interfaces and Vehicular Applications 2011 (http://auto-ui.org). Salzburg. 30.11-2.12.2011

Bryan Reimer: Opening keynote at Auto-UI 2011 in Salzburg

Bryan started his keynote talk the automotive user interface conference (auto-ui.org) in Salzburg with reminding us that having controversial discussions about the HMI in the car is not new. Quoting a newspaper article from the 1930s on the introduction of the radio in the car and its impact on the driver he picked an interesting example, that can be seen as the root of many issues we have now with infotainment systems in the car.

The central question he raised is: how to create user interface that fit human users? He made an important point: humans are not “designed” to drive at high speed in complex environments; perception has evolved for walking and running in natural environment. Additionally to the basic limitations of human cognition, there is a great variety of capabilities of drivers, their skills and cognitive ability (e.g. influence of age). A implication of the global change is demographics is that the average capabilities of a drivers will be reduced – basically as many older people will be drivers…

Over the last 100 years cars have changes significantly! Looking more closely Bryan argues that much of the chance happened in the last 10 years. There has been little change from the 1950s to the 1990s with regard to the car user interface.

It is apparent that secondary tasks are becoming more important to the user. Users will interact more while driving because the can. It is however not obvious that they are capable of it.

Even given these developments it is apparent that driving has become safer. Passive safety has been improved massively and this made driving much safer. There seems to be a drawback to this as well, as people may take greater risks as they feel safer. The next step is really to avoid accidence in the first place. Bryan argues that the interaction between driver, environment, and vehicles is very important in that. He suggests that we should make more of an effort to create systems that fit the drivers.

The Yerkes-Dodson Law helps to understand how to design systems that keep peoples attention in the optimal performance. He made an important point: there are certain issues that cannot be solved, e.g. if someone is tired we can do only very little – the driver will need to rest. We should make sure that we take these things into account when designing systems.

Visual distraction is an obvious factor and much discussed in the papers at the conference – but Bryan argued that “eyes on the road” is not equal to “mind on the road”. I think this is really a very important point. Ensuring that people keep their eyes on the road, seeing things is not enough. The big resulting question is how to keep or get people focused on the street and environment. It seems there is some more research to do…

The variety of interfaces and interaction metaphors build into cars opens more choices but at the same time creates problems, as people need to learn and understand them. A simple question such as: How do you switch the car off? may be hard to answer (Bryan had the example of a car with a push button starter, where you cannot remove the key). I think there are simple questions that can be learned from industry and production machines… add an emergency stop button and make it mandatory 😉

If you are interested more about Bryan’s work look at his webpage or his page at the MIT agelab or one of his recent publications [1] in the IEEE Pervasive Computing Magazine’s special issue on automotive computing, see [2] for an introduction to the special issue.

Sorry for the poor quality photos … back row and an iPhone…

[1] Joseph F. Coughlin, Bryan Reimer, and Bruce Mehler. 2011. Monitoring, Managing, and Motivating Driver Safety and Well-Being. IEEE Pervasive Computing 10, 3 (July 2011), 14-21. DOI=10.1109/MPRV.2011.54 http://dx.doi.org/10.1109/MPRV.2011.54

[2] Albrecht Schmidt, Joseph Paradiso, and Brian Noble. 2011. Automotive Pervasive Computing. IEEE Pervasive Computing 10, 3 (July 2011), 12-13. DOI=10.1109/MPRV.2011.45 http://dx.doi.org/10.1109/MPRV.2011.45

Our Paper and Note at CHI 2010

Over the last year we looked more closely into the potential of eye-gaze for implicit interaction. Gazemarks is an approach where the users’ gaze is continuously monitored and when leaving a screen or display the last active gaze area is determined and store [1]. When the user looks back at this display this region is highlighted. By this the time for attention switching between displays was in our study reduced from about 2000ms to about 700ms. See the slides or paper for details. This could make the difference that we enable people to safely read in the car… but before this more studies are needed 🙂

Together with Nokia Research Center in Finland we looked at how we can convey the basic message of an incoming SMS already with the notification tone [2]. Try the Emodetector application for yourself or see the previous post.

[1] Kern, D., Marshall, P., and Schmidt, A. 2010. Gazemarks: gaze-based visual placeholders to ease attention switching. In Proceedings of the 28th international Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI ’10. ACM, New York, NY, 2093-2102. DOI= http://doi.acm.org/10.1145/1753326.1753646

[2] Sahami Shirazi, A., Sarjanoja, A., Alt, F., Schmidt, A., and Hkkilä, J. 2010. Understanding the impact of abstracted audio preview of SMS. In Proceedings of the 28th international Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA, April 10 – 15, 2010). CHI ’10. ACM, New York, NY, 1735-1738. DOI= http://doi.acm.org/10.1145/1753326.1753585

PS: the social event was at the aquarium in Atlanta – amazing creatures! Again supprised how well the N95 camera works even under difficult light conditions…

CFP: 2nd Int. Conf. on Automotive User Interfaces and Interactive Vehicular Applications

The call for the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications is online – see http://auto-ui.org – AutomotiveUI’10.

The conference will be in Pittsburgh on 11-12 Nov 2010.

Do not miss the submission deadline: 02 July 2010.

The call includes a wide range of topics, including:

  • new concepts for in-car user interfaces
  • multi-modal in-car user interfaces
  • in-car speech user interfaces
  • text input and output while driving
  • multimedia interfaces and in-car entertainment
  • evaluation of in-car user interfaces
  • methods and tools for automotive user interface research
  • development tools and methods for automotive user interfaces
  • automotive user interface frameworks and toolkits
  • detecting and estimating user intentions
  • detecting user distraction and estimating cognitive load
  • user interfaces for assistive functionality
  • biometrics and physiological sensors as a user interface component
  • using sensors and context for interactive experiences in the car
  • user interfaces for information access while driving
  • user interfaces for navigation systems
  • applications and user interfaces for inter-vehicle communication
  • in-car gaming

We enjoyed last years conference in Essen 🙂 There are several posts online in my blog and we had a conference report in IEEE Pervasive Magazine [1]. Last years proceedings are online in the ACM DL and on the 2009 conference website.

The full call for papers is online at: http://auto-ui.org.

[1] Albrecht Schmidt, Wolfgang Spiessl, Dagmar Kern, “Driving Automotive User Interface Research,” IEEE Pervasive Computing, vol. 9, no. 1, pp. 85-88, Jan.-Mar. 2010, doi:10.1109/MPRV.2010.3.

Article on Driving Automotive User Interface Research in IEEE Pervasive

We wrote an article on the automotive user interface conference that took place in Essen in September 2009. In the current issue of the IEEE Pervasive Computing Magazine this paper is published and gives an overview of the conference [1]. We hope our article highlights the key ideas that were presented at the conference.

Abstract. Cars offer an interesting but challenging microcosm for pervasive computing research and, in particular, for interaction with pervasive computing systems. Increasingly, researchers are looking at interactive applications in the car and investigating human-car interaction from a computer science-rather than an ergonomics or mechanical engineering-perspective. This article reports on the International Conference on Automotive User Interfaces and Interactive Vehicular Applications, wherein participants shared presentations on topics such as aesthetics, user interaction and distraction, safety, and driver monitoring.

[1] Albrecht Schmidt, Wolfgang Spiessl, Dagmar Kern, “Driving Automotive User Interface Research,” IEEE Pervasive Computing, vol. 9, no. 1, pp. 85-88, Jan.-Mar. 2010, doi:10.1109/MPRV.2010.3.

Auto-UI 2010 announced – 2009 Proceedings available in the ACM DL

The Auto-UI 2009 conference in Essen is over – and for us it was very enjoyable to have this many visitors at the University of Duisburg-Essen – see the photos. The conference facilitated good discussions and had a very constructive atmosphere. We should continue this exchange of ideas and there is always room for improvement… and that is why there is a Auto-UI conference 2010 in Pittsburgh, US – and there is interest beyond this in hosting the conference.

You can register to get information about the next conference on the Auto-UI webpage.

The proceedings are now online in the ACM DL and the linked on the program website.

Social event at Zeche Zollverein, Accidents are avoidable

In the evening we went to Zeche Zollverein – a world cultural heritage site called “the most beautiful coal mine in the world”. We got a guided tour and had dinner in the Kokerei.
It was interesting to see and learn about working conditions – which were really hard. 100 years ago it was common that live expectancy of the workers was less that 60, that there was typically one serious accident per day and that about 30 people died every year in the coal mine.

We find that nowadays inhumane and it would be in Germany (and many other countries) completely unacceptable. Coming back to cars … we accept that in order to have personal transportation it sees unavoidable to have accidents and that 4477 people were killed 2008 in traffic accidents in Germany (which was lower than all the years before). Perhaps in 100 years people will look back at us similar to how we look back at the working conditions in coal mines 100 years ago. And I think research in Automotive User Interfaces can help working towards safer individual traffic.

Automotive UI 2009 – Proceedings online available

The proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009) [1] are freely available on the conference website and in the ACM digital library (see the table of contents of the proceedings). We created a printed version of the proceedings and it seemed that a lot of participants used it during the conference – so paper seems to have still a value (at least to some of us).

We decided to pursue an open policy for disseminating the proceedings. The authors keep the copyright of their paper and the authors grant the ACM digital library and the conference to distribute the electronic version over the web site (and as printed book and on a USB-Stick in car-shape). We think this approach maximizes the exposure and hence is good for the community. We are happy that the ACM agreed to this model!

If you are interested in the conference and you want to be updated please register for receiving information on future conference.

[1] Albrecht Schmidt, Anind Dey, Thomas Seder, Oskar Juhlin, Dagmar Kern. Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009). Essen. Germany. 21-22 Sept. 2009. (table of contents of the proceedings in the ACM DL)

Dagmar Kern presents a Automotive UI Design Space

Dagmar presents her work on a design space for automotive user interfaces [1]. The design space allows to categorize user interface components and elements with regard to interaction agent, position in the car, and type of interaction. The design space can be used to compare interfaces and as tool for assessing new opportunities for interaction.

The design space is based on an analysis of more than 700 pictures from IAA 2007. The photos (and soon photos from IAA 2009) are available at https://www.pcuie.uni-due.de/AUI/

[1] Kern, D. and Schmidt, A. 2009. Design space for driver-based automotive user interfaces. In Proceedings of the 1st international Conference on Automotive User interfaces and interactive Vehicular Applications (Essen, Germany, September 21 – 22, 2009). AutomotiveUI ’09. ACM, New York, NY, 3-10. DOI= http://doi.acm.org/10.1145/1620509.1620511

Keynote at Automotive UI 2009: Gert Hildebrand, MINI/BMW

Tom Seder and I openend the conference and welcomed our keynote speaker.

I was very excited that Gert Volker Hildebrand accepted to be the keynote speaker for the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009). He is with BMW Group in Munich and is the director of design for MINI. The topic of his talks was: “MINI Design: From the Original to the Original. The path from Center Speedo to Center Globe”. When I first came across the UI concept I wanted to meet the person – and a keynote is always one way 😉

I introduced the keynote with pictures from the Italian Job Movies (the first from 1969 and the second from 2003) and I find it impressive that the re-design inspired people to redo the movie.
In his talk he explained the design language used in the MINI- in short everything is a circles or a derivatives of circles. The concept of the center globe is a central sphere display that uses layers to include information. It has a horizontal surface (like a stage) and a background as well as a foreground.

The concept separates the UI for the driver (e.g. she gets navigation) and the passenger (she gets a access to the Internet). Search on Google or Bing for Mini Center-Globe and you get the idea. The concept uses a physical object (a sphere again) to transport content and to grand access – this reminded me of Durrell Bishop’s marble answering machine… Tangible UIs again 🙂

Gert Hildebrand also recommended his book “Mini Design” by Othmar Wickenheiser and Gert Hildebrand. The books contains many design sketches and is partly English and partly German (only available at Amazon in Germany).

Overall the presentation showed again that likeability and aesthetics play an essential role in creating an attractive product – and especially an interactive product. Opening Automotive UI 2009 I made an analogy to mobile phones in 1998. Phones were then closed systems, UIs were very basic and it was very hard for 3rd parties to create applications. And now – 10 years later – UI and applications seem to play a more important role than the core technologies (or why would in 2007 people think a phone with a 2 Megapixel and without video recording and no UMTS is great).

Special issue of I-COM on automotive user interfaces

Together with Susanne Boll and Klaus Bengler I was guest editor for a special issue of the I-COM magazine on automotive user Interfaces. The papers are largely in German (but there are English abstracts available). The special issue shows different examples of work in this domain.

Dagmar and Stefan have a paper that describes the CARS driving simulator and its application [1]. Together with Stefan and Wolfgang from BMW research I published a paper on search interfaces in the car [2] – which was originality investigated in two master theses in Munich and also discussed in a CHI Note [3].

[1] Dagmar Kern, Schneegaß Stefan. CARS – Konfigurierbarer Fahrsimulator zur Bewertung der Fahrerablenkung (CARS – Configurable Automotive Research Simulator). i-com, Volume 8, Issue: 2 (Nutzungsschnittstellen und interaktive Anwendungen im Auto), 08/2009, ISSN: 1618-162X, pp. 30-33. doi: 10.1524/icom.2009.0022

[2] Wolfgang Spießl, Stefan Graf , Albrecht Schmidt. Suchbasierte Interaktion mit Fahrerinformationssystemen (Search-Based User Interfaces for In-Car Interaction). i-com, Volume 8, Issue: 2 (Nutzungsschnittstellen und interaktive Anwendungen im Auto), 08/2009, ISSN: 1618-162X, pp. 5-9. doi: 10.1524/icom.2009.0017

[3] Graf, S., Spiessl, W., Schmidt, A., Winter, A., and Rigoll, G. 2008. In-car interaction using search-based user interfaces. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 1685-1688. DOI= http://doi.acm.org/10.1145/1357054.1357317

Summer party at the chair of ergonomics in Munich

On Friday afternoon I was at the summer party of the chair of ergonomics at the Technical University of Munich. Klaus Bengler, who took over the chair earlier this year and became professor, had in his talk 3 interesting points to take away:

  1. to assess more how much does bad ergonomics costs us (from health to missed sales)
  2. to quantify the value of ergonomics in real money in order to make it comparable with other factors in product design
  3. to include ergonomics as an integral part of the development process

From my Computer Science/HCI perspective I think (2) would be top of the list – as we have good approaches to (3) but need (2) to push it and as (1) is part of (2)… It would be great to have an argument based on economics. E.g. adding tactile feedback will costs x € and it will increase the value of the product by y € – if x>y do it – else don’t … still no idea how one would do this – but would be great if possible!

The researchers and students had prepared a large number of demos – mainly centered on ergonomics in the car, sports ergonomics, and mobile eye-tracking. Hard to pick a favorite but I liked the joystick control for steering a car a lot (there will be a paper on this at the automotive UI conference).

What do people like about navigation system?

I came across this study in computer bild – you should not cite it as it in a scientific paper as “computer bild” – is consumer paper telling people mainly which computers to buy and how to use obvious features in software 😉

Nevertheless it is interesting and gave me some ideas what navigations systems are good for and it is another example that user needs on an abstract level (e.g. as in Maslows hierarchy of needs) could be interesting to inform designs.

If you do not read German here are the results in short:

  • 91% faster to their destination
  • 88% less often being lost
  • 88% feel saver when driving with a SatNav
  • 67% less often in traffic jams
  • 57% driving is more fun
  • 54% argue less in the car because of SatNav

If you want to cite it there is the original german press relese from BITKOM. It states that the study was based on about 500 people who drove themselfs with a navigation system sometime in the last to years. Probably there is a scientific paper with similar results…

Auto-UI Conference accepts 12 full papers and 10 notes

For the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009) we got many quality submissions. The review process is now complete and we accepted 12 full papers and 10 notes for oral presentation at the conference. The list of accepted contributions is online at auto-ui.org.

As a number of people have asked if the still can submit to the program and as many of the rejected papers raise interesting aspects we decided to have Posters as a further submission category. We have a continuous submission process for poster abstracts till Sept 1st 2009. Earlier submissions receive feedback within 2 weeks. For details see the poster call for AutomotiveUI 2009.

If you submit somit your poster abstract during the next week, you will get the notification before the early registration deadline, which is August 6, 2009.

The registration is open and the conference is held in Essen, Mon/Tue 21 – 22 September 2009 – right after mobile HCI 2009 (which is in Bonn, just 100km away).

Automotive UIs – conference update, cool UI

The automotive user interface conference has received nearly 40 (to be exact 37) high quality submissions – we are really thrilled about the contributions – and now the review process is on! We will have more details on the program in a number of weeks.

Not a submission to the conference – but nevertheless cool: the MINI center globe UI – a 3D display concept for cars:

Our Publications at Pervasive – Public Displays, Car Adverts, and Tactile Output for Navigation

Our group was involved in 3 papers that are published at Pervasive 2009 in Nara.

The first contribution is a study on public display that was presented by Jörg Müller from Münster. The paper explores display blindness that can be observed in the real world (similarly to banner blindness) and concludes that the extent to which people look at displays is very much correlated to the users expectation of the content of a display in a certain location [1].

The second short paper is a survey on car advertising and has been conducted in the context of the master thesis of Christoph Evers. The central question is about the design space of dynamic advertising on cars and how the users perceive such a technology [2].

Dagmar presented a paper on vibra-tactile output integrated in the steering wheel for navigation systems in cars. The studies explored how multi-modal presentation of information impact driving performance and what modalities are preferred by users. The general conclusion is that combining visual information with vibra-tactile output is the best option and that people prefer multi-modal output over a single modality [3].

[1] Jörg Müller, Dennis Wilmsmann, Juliane Exeler, Markus Buzeck, Albrecht Schmidt, Tim Jay, Antonio Krüger. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. 7th International Conference on Pervasive Computing 2009. Nara, Japan. Springer LNCS 5538, pp 1-8.
http://www.springerlink.com/content/gk307213786207g2

[2] Florian Alt, Christoph Evers, Albrecht Schmidt. User’s view on Context-Aware Car Advertisement. 7th International Conference on Pervasive Computing 2009. Nara, Japan. Springer LNCS 5538, pp 9-16.
http://www.springerlink.com/content/81q8818683315523

[3] Dagmar Kern, Paul Marshall, Eva Hornecker, Yvonne Rogers, Albrecht Schmidt. Enhancing Navigation Information with tactile Output Embedded into the Steering Wheel. 7th International Conference on Pervasive Computing 2009. Nara, Japan. Springer LNCS 5538, pp 42-58.
http://www.springerlink.com/content/x13j7547p8303113

Andreas Riener visits our lab

Andreas Riener from the University of Linz came to visit us for 3 days. In his research he works on multimodal and implicit interaction in the car. We talked about several new ideas for new user multimodal interfaces. Andreas had a preseure matt with him and we could try out what sensor readings we get in different setups. It seems that in particular providing redundancy in the controls could create interesting opportunities – hopefully we find means to explore this further.

App store of a car manufacturer? Or the future of cars as application platform.

When preparing my talk for the BMW research colloquium I realized once more how much potential there is in the automotive domain (if you looks from am CS perspective). My talk was on the interaction of the driver with the car and the environment and I was assessing the potential of the car as a platform for interactive applications (slides in PDF). Thinking of the car as a mobile terminal that offers transportation is quite exciting…

I showed some of our recent project in the automotive domain:

  • enhance communication in the car; basically studying the effect of a video link between driver and passenger on the driving performance and on the communication
  • handwritten text input; where would you put the input and the output? Input on the steering wheel and visual feedback in the dashboard is a good guess – see [1] for more details.
  • How can you make it easier to interrupt tasks while driving – we have some ideas for minimizing the cost of interruptions for the driver on secondary tasks and explored it with a navigation task.
  • Multimodal interaction and in particular tactile output are interesting – we looked at how to present navigation information using a set of vibra tactile actuators. We will publish more details on this at Pervasive 2009 in a few weeks.

Towards the end of my talk I invited the audience to speculate with me on future scenarios. The starting point was: Imagine you store all the information that goes over the bus systems in the car permanently and you transmit it wireless over the network to a backend storage. Then image 10% of the users are willing to share this information publicly. That is really opening a whole new world of applications. Thinking this a bit further one question is how will the application store of a car manufacturer look in the future? What can you buy online (e.g. fuel efficiency? More power in the engine? A new layout for your dashboard? …). Seems like an interesting thesis topic.

[1] Kern, D., Schmidt, A., Arnsmann, J., Appelmann, T., Pararasasegaran, N., and Piepiera, B. 2009. Writing to your car: handwritten text input while driving. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04 – 09, 2009). CHI EA ’09. ACM, New York, NY, 4705-4710. DOI= http://doi.acm.org/10.1145/1520340.1520724

New Conference on Automotive User Interfaces

If industries are not doing well one way forward is to promote innovation!

Since a number of years it became apparened that many PhD students in computer science and especially in human computer interaction work on topics related to user interfaces in the car. We think it is a good idea to forster a community in this area and hence we run the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009)  in Essen, Germany. The conference is in the week after Mobile HCI and takes place Mon/Tue 21 – 22 September 2009. 
Submission deadline: 02 June 2009

Andreas Riener defends his PhD in Linz

After a stop-over in Stansted/Cambridge at the TEI conference I was today in Linz, Austria, as external for the PhD defense of Andreas Riener. He did his PhD with Alois Ferscha and worked on implicit interaction in the car. The set and size of experiments he did is impressive and he has two central results. (1) using tactile output in the car can really improve the car to driver communication and reduce reaction time. And (2) by sensing the force pattern a body creates on the seat driving relates activities can be detected and to some extend driver identification can be performed. For more details it makes sense to have a look into the thesis 😉 If you mail Andreas he will probably sent you the PDF…
One of the basic assumptions of the work was to use implicit interaction (on input and output) to lower the cognitive load while driving – which is defiantly a valid approach. Recently however we also discussed more the issues that arise when the cognitive load for drivers is to low (e.g. due to assistive systems in the car such as ACC and lane keeping assistance). There is an interesting phenomenon, the Yerkes-Dobson Law (see [1]), that provides the foundation for this. Basically as the car provides more sophisticated functionality and requires less attention of the user the risk increase as the basic activation of the driver is lower. Here I think looking into multimodality to activate the user more quickly in situations where the driver is required to take over responsibility could be interesting – perhaps we find a student interested in this topic.
[1] http://en.wikipedia.org/wiki/Yerkes-Dodson_law (there is a link to the 1908 publication by Yerkes, & Dodson)

Voice interaction – Perhaps it works …

Today we visited Christian Müller at DFKI in Saarbrücken. He organized a workshop on Automotive User Interfaces at IUI last week. My talk was on new directions for user interfaces and in particular arguing for a broad view on multimodality. We showed some of our recent projects on car user interfaces. Dagmar gave a short overview of CARS our simulator for evaluating driving performance and driver distractions and we discussed options for potential extensions and shortcomings of the Lane Change Task.
Being a long time skeptic about voice interfaces I was surprise to see a convincing demo of a multimodal user interface combining voice and a tactile controller in the car. I think this could be really an interesting option for future interfaces. 
Classical voice-only interfaces usually lack basic properties of modern interactive systems, e.g. as stated in Shneiderman’s Golden Rules or in Norman’s action cycle. In particular the following points are most often not well realized in voice-only system:
  • State of the system is always visible
  • Interactions with the system provide immediate and appropriate feedback
  • Actions are easily reversible
  • Opportunities for interaction are always visible 
By combing a physical controller with voice and having at the same time the objects of interaction visible to the user (as part of the physical system that is controlled, e.g. window, seat) these problems are addressed in a very interesting way. I am looking forward to seeing more along these lines – perhaps we should also not longer ignore speech interaction in our projects 😉 

Known route – driving your car in mental auto-pilot?

Mandy Marder, a doctoral student at university hospital in Essen has done an interesting study, looking at the activity of the brain at different driving situations. It seems that if you are driving a well know route you are less alert than when you drive an unknown route (see press release, we have yet to find the appropriate reference). This is an interesting finding that may help to inform some of our work on automotive user interfaces. Together with trends that move more responsibility from the driver to assitive functions this nay be an indication that driving could be a valid domain for serious games.

Workshop on Automobile User Interfaces

For the second time we ran this year a workshop on automobile user interfaces and interactive applications in the car at the German HCI conference: http://automotive.ubisys.org/

In the first session we discussed the use of tactile output and haptics in automotive user interfaces. It appears that there is significant interest in this area at the moment. In particular using haptics as an additional modality creates a lot of opportunities for new interfaces. We had a short discussion about two directions in haptic output: naturalistic haptic output (e.g. line assist that feels like going over the side of the road) vs. generic haptic output (e.g. giving a vibration cue when to turn).

 I think the first domain could make an interesting project – how does it naturally feel to drive too fast, to turn the wrong way, to be too close to the car in front of you, etc…

In a further session we discussed framework and concepts for in-car user interfaces. The discussion on the use of context with the interface was very diverse. Some people argued it should be only used in non-critical/optional parts of the UI (e.g. entertainment) as one is not 100% sure if the recognized context is right. Others argue that context may provide a central advantage, especially in safety critical systems, as it gives the opportunity to react faster. 

In the end it comes always down to the question: to what extent do we want to have the human in the loop… But looking at Wolfgang’s overview slide it is impressive how much functionality depends already now on context…

In the third session we discussed tools and methods for developing and evaluating user interfaces in the car context. Dagmar presented our first version of CARS (a simple driving simulator for evaluation of UIs) and discussed findings from initial studies [1]. The simulator is based on the JMonkey Game engine and available open source on our website [2].

There were several interesting ideas on what topics are really hot in automotive UIs, ranging from interfaces for information gather in Car-2-Car / Car-2-Envrionment communication to micro-entertainment while driving.

[1] Dagmar Kern, Marco Müller, Stefan Schneegaß, Lukasz Wolejko-Wolejszo, Albrecht Schmidt. CARS – Configurable Automotive Research Simulator. Automotive User Interfaces and Interactive Applications – AUIIA 08. Workshop at Mensch und Computer 2008 Lübeck 2008

[2] https://www.pcuie.uni-due.de/projectwiki/index.php/CARS

PS: In a taxi in Amsterdam the driver had a DVD running while driving – and I am sure this is not a form of entertainment that works well (it is neither fun to watch, nor is it save or legal).

Is it easier to design for touch screens if you have poor UI designers?

Flying back from Sydney with Qantas and now flying to Seattle with Lufthansa I had to long distance flights in which I had the opportunity to study (n=1, subject=me, plus over-shoulder-observation-while-walking-up-and-down-the-aisle 😉 the user interface for the in-flight entertainment.

The 2 systems have very different hardware and software designs. The Qantas infotainment system is a regular screen and interaction is done via a wired moveable remote control store in the armrest. The Lufthansa system uses a touch screen (It also has some hard buttons for volume in the armrest). Overall the content on the Qantas system comprised of more content (more movies, more TV-shows) including real games.

The Qantas system seemed very well engineered and the remote control UI worked was greatly suited for playing games. Nevertheless the basic operation (selecting movies etc.) seemed more difficult using the remote control compared to the touch screen interface. In contrast the Lufthansa system seems to have much room for improvement (button size, button arrangement, reactions times of the system) but it appeared very easy to use.

So here are my hypotheses:

Hypothesis 1: if you design (public) information or edutainment systems (excluding games) using a touch screen is a better choice than using an off-screen input device.

Hypothesis 2: with UI design team of a given ability (even a bad UI design team) you will create a significantly better information and edutainment systems (excluding games) if you use a touch screen than using an off-screen input device.

From the automotive domain we have some indications that good off-screen input device are really hard to design so that they work well (e.g. in-build-car navigation system). Probably I should find a student to proof it (with n much larger than 1 and other subjects than me).

PS: the Lufthansa in-flight entertainment runs on Windows-CE 5.0 (the person in front of me had mainly the empty desktop with the Win CE logo showing) and it boots over network (takes over 6 minutes).

CfP: Automotive User Interfaces and Interactive Applications – AUIIA 08

After last year’s successful workshop on automotive user interfaces we are planning to run another one this year. We – Susanne Boll (Uni Oldenburg), Wolfgang Spießl (BMW), Matthias Kranz (DLR) and Albrecht Schmidt – are really looking forward to many interesting submissions and a cool workshop program. The theme gains a the moment some momentum, which was very visible at the Special Interest Group meeting at CHI2008.

More information on the workshop and a call for paper is available at: http://automotive.ubisys.org/