Heiko Drewes defended his PhD – Congratulations! (No. 4)

Heiko worked the last 6 years towards his PhD. He did a lot of things during this time – and even though not everything was on his PhD topic – I think the time was well spent, e.g. some visually interesting things came out [1].

The core of his PhD was on eye gaze as an additional modality for human computer interaction and it is worthwhile to read the thesis (which will be available in a few weeks) – till than you can have a look at the following papers. [2] describes a system that positions the mouse pointer on touching the mouse to the location on the screen where look at; [3] introduces the concept of gaze gestures – gestures done with the eyes. There is an interesting alt.chi paper coming on Fitts’ law (don’t start Heiko on this ;-).

In the evening Raphael showed me his interactive surface prototype [4] – it is really big :-). He is also co-organizing a course on Sketching with Hardware.

[1] Heiko Drewes. Yara – Yet Another Random Art.

[2] Drewes, H. and Schmidt, A. 2009. The MAGIC Touch: Combining MAGIC-Pointing with a Touch-Sensitive Mouse. In Proceedings of the 12th IFIP TC 13 international Conference on Human-Computer interaction: Part II (Uppsala, Sweden, August 24 – 28, 2009). Lecture Notes In Computer Science, vol. 5727. Springer-Verlag, Berlin, Heidelberg, 415-428. DOI= http://dx.doi.org/10.1007/978-3-642-03658-3_46

[3] Heiko Drewes, Albrecht Schmidt. 2007. Interacting with the Computer using Gaze Gestures. In Proceedings of the 11th IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 2007, Rio de Janeiro, Brazil, September 2007, ISBN 978-3-540-74794-9, DOI= http://dx.doi.org/10.1007/978-3-540-74800-7_43

[4] Raphael Wimmer, Florian Schulz, Fabian Hennecke, Sebastian Boring, Heinrich Hussmann. Curve: Blending Horizontal and Vertical Interactive Surfaces. Adjunct Proceedings of the 4th IEEE Workshop on Tabletops and Interactive Surfaces (IEEE Tabletop 2009), Banff, Canada, Nov. 2009

Students generate interesting ideas, links to photos

In the final part of the summer school the students worked in groups to create new ideas for displays and their use. We had 5 groups working hard – all creating amazing results for such a short time. Sometimes I wonder how we could better utilize this design exercise as the results were really exciting.

On group looked into the concept of mobile and contextual displays on garments – the idea T-SHARE assesses potential applications, when having networked displays included in T-Shirts (see the group presentation for details). This moves an idea with have investigated over the last year to a new level. I am really thrilled and I think we should really look how to setup a larger project on this topic.

We worked hard 🙂 but in the time between we enjoyed our trip – here are the photos I took (Bahai Garden, climbing with Keith and Antonio, the trip to Jerusalem, School and Beach in Haifa).

[1] Florian Alt, Albrecht Schmidt, Christoph Evers: Mobile Contextual Displays. In: Pervasive Advertising Workshop @ Pervasive 2009. Nara, Japan 2009.

Bastian Pfleging joined the team (some weeks ago :-)

Bastian Pfleging joined us some weeks ago – his first day at work was at TEI’09 in Cambridge. We he came back he was so well integrted in the team that I forgot to write a blog entry. In fact he was already at a workshop with us some weeks ago – remember the photo?

Bastian studied computer science at TU Dortmund and his final project was on computer vision based interaction in smart environments in the Group of Gernot A. Fink.

No 3 ;-) Paul defends his PhD – Congratulations!

Paul Holleis defended today his PhD thesis on “Integrating Usability Models into Pervasive Application Development” in Munich – My No.3. He worked together with Matthias on the DFG project “Embedded Interaction”. Paul is now with Docomo Eurolabs in Munich.

The set of publication Paul produced is impressive – you probably don’t have time to read all of them 😉 but at least take a look at the following ones: an extension to KLM for mobile phones [1], an integrated development environment that includes usability models [2], and a explorative study in wearable computing [3].

In Germany we have a tradition to make a hat for the candidate. Paul’s hat has items on it that insiders can interpret, including a world map with bikes, miniature TEI’07 proceedings, Birkenstock shoes, a key with a label “Amsterdam”, a display, a phone, a yoyo, a control unit for vibration motors, 4 flags of town, and some context-aware plug-and-play hardware (and obviously batteries).
[1] Holleis, P., Otto, F., Hussmann, H., and Schmidt, A. 2007. Keystroke-level model for advanced mobile phone interaction. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 – May 03, 2007). CHI ’07. ACM, New York, NY, 1505-1514. DOI=http://doi.acm.org/10.1145/1240624.1240851
[2] P. Holleis, A. Schmidt: MakeIt: Integrate User Interaction Times in the Design Process of Mobile Applications. 6th International Conference on Pervasive Computing (Pervasive’08), Sydney, Australia, May 2008
[3] Holleis, P., Schmidt, A., Paasovaara, S., Puikkonen, A., and Häkkilä, J. 2008. Evaluating capacitive touch input on clothes. InProceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services(Amsterdam, The Netherlands, September 02 – 05, 2008). MobileHCI ’08. ACM, New York, NY, 81-90. DOI= http://doi.acm.org/10.1145/1409240.1409250

Richard Atterer defended his PhD-thesis

At LMU in Munich Richard Atterer defended his PhD thesis on Usability Tool Support for Model-Based Web Development. The external examiner was Prof. Martin Gaedke– it was great meeting Martin again, we shared an office some years back at TecO, University of Karlsruhe. While I was with LMU I worked with Richard on a number of interesting topics and I learned to value his technical skills and insightful reflection – hope he stays in academia 😉 
Our experiments with remote usability assessment and effectively fine-grain user tracking on web pages [1] created a number of ideas for follow-up projects. The overall concept is really simple yet powerful: people use a proxy server (willingly or transparent) and by these means Javascript code is included in the html-source of arbitrary web pages to add new functionality [2]. Florian Alt extended this concept to an annotation system and currently we look into more general implication of this approach.
While writing his theses Richard countered our routine question “how is progress?”  with a dynamically generated graph on his webpage. Each time he checked his document in SVN the graph was updated with the current number of words and pages … but we still kept asking 😉 
 [1] Atterer, R. and Schmidt, A. 2007. Tracking the interaction of users with AJAX applications for usability testing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 ? May 03, 2007). CHI ’07. ACM, New York, NY, 1347?1350. DOI= http://doi.acm.org/10.1145/1240624.1240828
[2] Atterer, R., Wnuk, M., and Schmidt, A. 2006. Knowing the user’s every move: user activity tracking for website usability evaluation and implicit interaction. In Proceedings of the 15th international Conference on World Wide Web (Edinburgh, Scotland, May 23 ? 26, 2006). WWW ’06. ACM, New York, NY, 203?212. DOI= http://doi.acm.org/10.1145/1135777.1135811 

Matthias Kranz defended his PhD

Today Matthias Kranz defended his PhD thesis „Engineering Perceptive User Interfaces“ successfully at the University of Munich! Congratulations… and remember “Training to become a Jedi is not an easy challenge. And even if you succeed, it’s a hard life.” (Qui-Gon Jinn, Star Wars Episode I: The Phantom Menace)

After Enrico Rukzio Matthias is the second of my PhD students who worked with me in Munich to finish. He is now with the German Aerospace center (DLR).
Matthias worked on the DFG project “Embedded Interaction” and has created and published an impressive set of prototypes and studies in pervasive computing over the last 4 years. See his homepage for details. If you only have time to read 2 pages – here is my suggestion: Context-aware kitchen utilities [1].
The personalized doctoral hat is a German tradition –and Matthias got a fully functional prototype of a perceptive doctoral hat (following the modification and restriction approach suggested in his thesis, but created without end-user involvement to keep the surprise 😉

Insider hint: http://en.wikipedia.org/wiki/Microfilm – just don’t!

[1] Kranz, M., Schmidt, A., Maldonado, A., Rusu, R. B., Beetz, M., Hörnler, B., and Rigoll, G. 2007. Context-aware kitchen utilities. In Proceedings of the 1st international Conference on Tangible and Embedded interaction (Baton Rouge, Louisiana, February 15 – 17, 2007). TEI ’07. ACM, New York, NY, 213-214. DOI= http://doi.acm.org/10.1145/1226969.1227013

Trip to North Korea

[see the whole set of photos from tour to North Korea]

From Gwangju we took the bus shortly after midnight to go for a trip to North Korea. The students did a great job in organizing ISUVR and the trip. It was great to have again some time to talk to Yoosoo Oh, who was a visiting researcher in Munich in our group.

When entering North Korea there are many rules, including that you are not allowed to take cameras with tele-lenses over 160mm (so I had to take only the 50mm lens) and you must not bring mobile phones and mp3 players with you. Currently cameras, phones and MP3 players are visible with the human eye and to detect in an x-ray. But it does not take much imagination to see in a few years extremely small devices that are close to impossible to spot. I wonder how this will change such security precautions and whether or not I will in 10 years still possible to isolate a country from access to information. I doubt it…

The sightseeing was magnificent – see the photos of the tour for yourself. We went onto the Kaesong tour (see http://www.ikaesong.com/ – in Korea only) It is hard to tell how much of the real North Korea we really saw. And the photos only reflect a positive selection of motives (leaving out soldiers, people in town, ordinary buildings, etc. as it is explicitly forbidden to take photos of those). I was really surprise when leaving the country they check ALL the pictures you took (in my case it took a little longer as it was 350 photos).

The towns and villages are completely different from what I have seen so far. No cars (besides police/emergency services/army/tourist busses) – but many people in the street walking or cycling. There were some buses in a yard but I have not seen public transport in operation. It seemed the convoy of 14 tourist buses is an attraction to the local people…

I have learned that the first metal movable type is from Korea – about 200 years before Gutenberg. Such a metal type is exhibited in North Korea and in the display is a magnifying glass in front of the letter – pretty hard to take a picture of…

Ali joined our group

Last month Aliresa Sahami finished his master thesis on multi-tactile interaction at BIT Bonn and joined our group in Essen. Ali worked for me a student resesearch assistant at Fraunhofer IAIS. During his studies in Bonn we published an interesting workshop paper on mobile health [1] and gave a related demo at Ubicomp [2].

[1] Alt, F., Sahami Shirazi, A., Schmidt, A. Monitoring Heartbeat per Day to Motivate Increasing Physical Activity. Ubiwell workshop at Ubicomp 2007.

[2] Sahami Shirazi, A.; Cheng, D.; Kroell, O.; Kern, D.; Schmidt, A.: CardioViz: Contextual Capture and Visualization for Long-term ECG Data. In: Adjunct Proceedings of Ubicomp 2007.

Why are not more people studying computer science?

Wherever I meet with companies at the moment one of the first questions is “do you have good students – we need people…”. It seems good computer science skills are useful 😉 However to me it is not clear why so few people go into this field. Here is my favorite short list what you should have to study CS: (1) you are creative; (2) you are communicative; (3) you solve problems systematically; (4) you have an ability to generalize.

Booting a start-up to teach?

We made our plans for setting up a company for creating a unique learning experience more specific. Uwe Bayer from Fraunhofer IAIS used in our discussion the phrase “don’t play to run company – really run a company” – which I think describes the essences of we would like to achieve. We plan to have some detailed information (and the recruitment process) out by the end of the month. If you are a student close to finishing your studies AND you have academic skills in your subject AND you have the drive to create a start-up THEN you should contact me in the beginning of June – we look for about 20 people with IT and business background that like to take a risk!

Florian Alt back from the US – and now with us in Essen

Florian Alt studied media informatics at the LMU in Munich and has now joined our group. In Munich he worked during his project thesis with me on how to improve hospital work in pervasive computing technologies [1]. Last year he came to Fraunhofer IAIS and did his master thesis (a annotation system for the WWW based on the UsaProxy, http://fnuked.de/usaproxy/). Before joining us he worked for some months in New York setting up an IT department for a German company that opened a branch in the USA… we are happy for the brain gain 😉

[1] A. Schmidt, F. Alt, D. Wilhelm, J. Niggemann, H. Feussner. Experimenting with ubiquitous computing technologies in productive environments. e & i Elektrotechnik und Informationstechnik, Springer Verlag. Volume 123, Number 4 / April, 2006. pages 135-139

Humangrid – are humans easier to program than systems?

In the afternoon I visited humangrid, a startup company in Dortmund. Their basic idea is to create a platform that offers opportunities for crowdsourcing – basically outsourcing small tasks that are easy to perform by humans to a large number of clickworkers. One example for such a scenario is tagging and classification of media. It is interesting that they aim to create a platform that offers real contracts and provides guaranties – which makes it in my eyes more ambitious than Amazon’s Mechanical Turk.

One interesting argument is that programming humans (as intelligent processors) to do a certain task that involves intelligence is easier and cheaper than creating software that does this completely automated. Obviously with software there is nearly zero-cost for performing the tasks – after the software is completed, however if the development costs are extremely high paying a small amount to the human processor for each task may still be cheaper. The idea is a bit like creating a prototype using wizard of oz – and not replacing the wizard in the final version.

In our discussion we developed some idea where pervasive computing and mobile technologies can link to the overall concept of the human grid and crowdsourcing creating opportunities for new services that are currently not possible. One of our students will start next month a master thesis on this idea – I am already curious if we get the idea working.

Tanja Döring joined our group

Today Tanja Döring started with our group in Essen. She did her MSc at the University of Hamburg with Steffi Beckhaus and Horst Oberquelle. I met her first last year at TEI’07 in Baton Rouge, where she presented work on a table for art historians [1]. This year Tanja was a student volunteer at TEI’08 in Bonn.

[1] Döring, T. and Beckhaus, S. 2007. The card box at hand: exploring the potentials of a paper-based tangible interface for education and research in art history. In Proceedings of the 1st international Conference on Tangible and Embedded interaction (Baton Rouge, Louisiana, February 15 – 17, 2007). TEI ’07. ACM, New York, NY, 87-90. DOI= http://doi.acm.org/10.1145/1226969.1226986

Finishing the course User Interface Engineering for this term

No we had the last lectures of the course User Interface Engineering for this term. We will have oral exams stating later this month. The whole set of slides I used over the term (a bit more than 800) are available on our website. This year we have the first time made a set of questions to assist revising the material. In total we have about 200 questions – and looking over the questions it is really interesting that user interface design is not as trivial as one thinks (after teaching it for several years 😉

Guest course at the University of Linz, MSc Pervasive Computing

I am teaching a guest course at the University of Linz in the Pervasive Computing master program. The topic is Unconventional User Interaction – User Interfaces in a Pervasive Computing World (http://www.ubicomp.net/uui). Today we started with an introduction to motivate how pervasive computing changes human computer interaction. I am already looking forward to the projects!

At dinner I learned why you can never have enough forks in a good restaurant. In case you loose your pen for the mobile phone a fork will do… The topic of the lecture is everywhere!

Deadline for Summer@IAIS soon

Not much time left to apply for the student research project. From 20.8. to 30.9.2007 we plan to design and implement a new specific search engine. The program is open to all computer science and media informatics students, primarily in Germany. We assume it will be very competitive. For accepted students we provide a HIWI-job at Fraunhofer IAIS for the 5 weeks. It will be possible to get credits for the course (IPEC lab course at the University of Bonn).

For more information please see: www.iais.fraunhofer.de/summer2007.html

Interaction Ivrea

Pascal Bihler send me today a link to an interesting teaching/research project at Ivrea (http://courses.interaction-ivrea.it/strangely/). The assignment is to think how a common artefact can be enhanced with digital technology. The results of the exercise are quite impressive. It seems that Interaction Ivrea is now somehow integrated into the Domus Academy in Milan.

When I was at Ivrea in November 2003 for the Jamboree of the disappearing computer initiative it was amazing to see the level of creativity – from the Ivrea design institute as well as from the various European projects in the disappearing computer program.

There at Ivrea I also met a really amazing person who has greatly influenced interaction design in the last 20 year: Gillian Crampton Smith. She was the founding director of the institute in Ivrea and has moved on to Venice (IUAV).

Pervasive Computing and Ethics

Together with Boriana Koleva I organized the doctoral colloquium at Pervasive 2007 in Toronto. We had 9 students presenting and discussing their PhD work with us.

One central observation was that we come to a point where we have to make more and more ethical decisions. Many things that are technical feasible and harmless within the lab may have sincere implications in the real world. If technologies for tracking, tracing and mining (e.g. social network analysis, location based services, context-aware systems) are deployed beyond the lab the question of choice becomes a real issue – are users aware of it and can they opt-out?

In the area of context-awareness technology has moved on since I started my PhD on the topic nearly 10 years ago – but amazingly scenarios did change little. Automatically detecting a meeting is still on the students slides. The more I learn and understand about context-awareness the more it becomes apparent that this apparently simple use case is amazingly hard!

Lecture at CDTM in Munich

The CDTM is a joint elite study program from LMU Munich and TU Munich (http://www.cdtm.de/). It offers a set of complementary course for students from different backgrounds including math, business studies, engineering, computer science and media informatics. In their course on multimodal HCI I gave today an introductory lecture on the motivation for and the basics of user interface engineering.

In the seminar room was a real typewrite – in fact a travel type write. It was a real good prop to discuss micro- and macro-efficiency.

One question about the sustainability of a competitive advantage based on user interfaces made me really think. As the user interface is visible it is really hard to protect the competitive advantage and IPR are difficult on this topic. Desktop GUIs are a good example how quickly ideas propagate between competing systems. The only real option to maintain a competitive advantage is to continuously innovate – keeping the status quo means falling behind. The fact that one can not keep new user interface concepts secret (if one includes them in a product) is one of the most exciting aspects of user interfaces research – it is fast moving because everyone shows off their results!

Web 2.0 for any page and site in the WWW

Florian Alt started his master thesis with us. He use the UsaProy (http://fnuked.de/usaproxy/) – a concept and software we (mainly Richard Atterer and Monika Wnuk) developed previously at LMU Munich – to create a new system that allows the annotation of web pages.

We think it is an interesting challenges to create a system that allows users to annotate any web page and make these annotations available to others.

With the concept we envision to bring Web 2.0 to any page and site in the WWW. Interactivity and community features are provided independently of the content provider and authors.