UNH IRES research interns on tour

Group photoStatmitte

Miriam and the UNH IRES research interns from the HCI lab went to Saarbrüken to visit the Saarbrüken University HCI group. The first lab visited was the DFKI Lab (or the German Research Center for Artificial Intelligence) where they met researcher Dr. Sven Gehring to get a tour. The tour exhibited demonstrations such as the possible future technology of grocery stores, collaborative reading environment on a single screen, augmented system to develop floor plans and similar layouts, and a viable poster voting system. In addition to the demos they were talked through some posters displayed on the various other projects being undertaken at the HCI group in Saarbrüken like mobile projection to facilitate learning guitar, large interactive displays, and even a mobile application to chart rock climbing paths of various difficulties.

GroceryDisplayWearables

The second lab visited was the Cluster of Excellence Multimodal Computing and Interaction (MMCI) lab. This is where doctoral researcher Martin Weigel gave a tour of the lab and went into detail about his project which was in wearable touch sensors that are worn on the skin.

Chloe Eghtebas

Doctoral colloquium in Tampere

For the second time we organized an international doctoral colloquium on HCI – mainly with students from Germany and Finland. This year it was hosted at the University of Tampere. 10 students in different stages of their PhD presented their work and ideas. The first one was in Oulu.

Besides many scientific and technological topics we discussed the process of doing a PhD. I shared my experience of doing a PhD based on an extened version of Jakob Badram’s fish model as well as with the PI-presentation model.

The fish: basically you start with a topic and it widens over time – till at some point you have to focus – and when you have focused and found the specific contribution you have to widen again a bit to cover the things you need for making it a coherent PhD-thesis. This applies to the technical skill set of the student as well as to the research topic. Pertti added a personal sanity graph – from the beginning when you think of how difficult a PhD is, to the middle were you think you know it all and everyone else in the research community has no clue, to the (hopefully) final stage where you get a objective view on your PhD (where you realize you made a contribution you can be proud of – but it is probably not going to change the whole world). It seemed that most people who have done a PhD in CS can relate to this graph…

Why do we need to teach children binary coding?

I am very much in favor of teaching children more than one number system (e.g. binary additional to the decimal system). To me this gives children a better understanding of the nature of numbers – I know that this seems not to be widely shared 😉


Now I found a further reason why it essential to know binary codes – How else would you decode this best before date on this chocolate bar if you would not know it!

Book chapter on Teaching Beyond the Classroom

Kati Mäkitalo-Siegl, Jan Zottmann, Frederic Kaplan and Frank Fischer organized a workshop that resulted in the book: Classroom of the Future. The book gives a very good overview and is in my view very well suited to run a seminar

We have one chapter in the book that talks about teaching beyond the classroom and outside a typical classroom using pervasive computing technologies [1]. Our chapter includes some of the work on tangible interaction we did in Munich, e.g. [2] and earlier experience where we did a school garden blog (in German only http://www.hcilab.org/albrecht/flachs-web/).

Details about the book and a free preview are available at the publisher’s side. The free preview includes an article on the classroom of the past – which I found quite interesting. If you are interested in our article, drop me a mail and I may find the draft.

[1] Paul Holleis, Albrecht Schmidt, Heiko Drewes, Richard Atterer, Petra Dollinger. Teaching Beyond the Classroom: Pervasive Computing Technologies for the Classroom of the Future. Classroom of the future. SensePublisher 2010, pp 63-85. ISBN:978-9460911026 (book at amazon)

[2] Terrenghi, L., Kranz, M., Holleis, P., and Schmidt, A. 2006. A cube to learn: a tangible user interface for the design of a learning appliance. Personal Ubiquitous Comput. 10, 2-3 (Jan. 2006), 153-158. DOI= http://dx.doi.org/10.1007/s00779-005-0025-8

Finishing my term as External Examiner at Trinity College Dublin

Over the last three years I have been regularly to Dublin to act as external examiner for the Ubicomp MSc course. For me this was a good experience to see how serious The School of Computing at Trinity College takes external quality control and how well processes are managed. And besides the administrative part I saw a great many interesting MSc dissertations over the years. Even though the term has come to an end I hope to travel to Dublin in the future too – perhaps on Holiday to see more of the city (which I did not really manage …)

PS: recession seems to have hit Ireland – I have never seen such short queue in Dublin airport – and it is definatly not the selfservice machines that reduced the queue …

Students generate interesting ideas, links to photos

In the final part of the summer school the students worked in groups to create new ideas for displays and their use. We had 5 groups working hard – all creating amazing results for such a short time. Sometimes I wonder how we could better utilize this design exercise as the results were really exciting.

On group looked into the concept of mobile and contextual displays on garments – the idea T-SHARE assesses potential applications, when having networked displays included in T-Shirts (see the group presentation for details). This moves an idea with have investigated over the last year to a new level. I am really thrilled and I think we should really look how to setup a larger project on this topic.

We worked hard 🙂 but in the time between we enjoyed our trip – here are the photos I took (Bahai Garden, climbing with Keith and Antonio, the trip to Jerusalem, School and Beach in Haifa).

[1] Florian Alt, Albrecht Schmidt, Christoph Evers: Mobile Contextual Displays. In: Pervasive Advertising Workshop @ Pervasive 2009. Nara, Japan 2009.

Reading material for summer school.

Tsvi Kuflik and Antonio Krüger organize from August 30th – September 3rd a German-Israeli Minerva School for Ubiquitous Display Environments: Intelligent Group Interaction, Foundations and Implementation of Pervasive Multimodal Interfaces. I will teach a session on: “Embedded interaction with display environments” and here is the list of recommended readings for the participants – if you are short on time only read the first one and glance over the other two.

Mahato, H., Kern, D., Holleis, P., and Schmidt, A. 2008. Implicit personalization of public environments using bluetooth. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, April 05 – 10, 2008). CHI ’08. ACM, New York, NY, 3093-3098. DOI= http://doi.acm.org/10.1145/1358628.1358813 (if you do not have access to ACM here is a copy on the web)

Schmidt, A.; van Laerhoven, K. 2001. How to build smart appliances? Personal Communications, IEEE. Volume 8, Issue 4, Aug 2001:66 – 71. DOI: 10.1109/98.944006. http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=944006 (if you do not have access to IEEE here is a copy on the web)

Villar N.; Schmidt A.; Kortuem G.; Gellersen H.-W. 2003. Interacting with proactive public displays. Computers and Graphics, Elsevier. Volume 27, Number 6, December 2003 , pp. 849-857(9). Draft Version “Interacting with proactive community displays” online available.

DIY Segway – to motivate embedded programming?

Elektor magazine features in the current issue a DIY Segway called Elektor Wheelie. The system is build around a ATMEGA32 and has obviously a lot of mechanics. For sensing an ADXL320 (acceleration sensor) and an IDG-300 (gyro) are used. Looks like a fun project – and you have full access to the software (not sure what you really would program differently, perhaps one can tune it to get faster 😉

Perhaps it could be a platform to motive embedded programming – with clear real-time constraints, as it hurts if you fall off… Next term we are teaching digital system design and programming of microcontroller systems – should we get one for the lab? Someone willing to built it?

Making Computer Science Exciting for Children – Kinderuniversität

Petra is teaching at the primary school in Satteldorf. As there is no University close by we decided to have a university afternoon at school. The idea behind this (in German Kinderuniversität) is to get young children excited for scientific topics and show that research is fun. The lecture should make them curious and motivate them to ask fundamental questions.

My lecture was on principles and technologies for communication (in German) and we looked fundamentally at what information is, how it relates to probabilities, how to encode information, and what devices people used and use for communication. For me this was a very exciting experience and also showed that we (as a discipline Computer Science) should probably look more into didactic and how to communicate fundamentals of our subject in school. So far many students associated computer science with using PowerPoint 🙁 but there are interesting starting points, e.g. a German book on algorithms for school children [1].

[1] Vöcking, B.; Alt, H.; Dietzfelbinger, M.; Reischuk, R.; Scheideler, C.; Vollmer, H.; Wagner, D. (Ed.). Taschenbuch der Algorithmen. 2008, ISBN: 978-3-540-76393-2

Linking the activities in the physical world to actions in the digital/virtual

Currently we have an assignment in our Pervasive Computing class that asks students to design and develop a system where actions are associated with artifacts. Technically students should develop a web based solution using RFID. Apropos RFID, … if you look for a good introduction on RFID read Roy Want’s IEEE Pervasive Magazin paper [1].

We use the hardware from http://nabaztag.com/ (Ztamp:s and Mir:ror) as the focus is on the concept and application and not on the underlying technology. To ease development Florian and Ali have developed a little system that offers WebCallBacks (students can register a URL and that is called when a tag is read).

Linking by tagging of objects has been well explored, e.g. [2] and [3], and I think it is about time that this technologies will make an impact in the consumer market – the technology gets cheap enough now (and perhaps one of our students has a great idea).

Some years back (in the last millennium) a company tried to push linking of paper adverts and digital content with the CueCat (http://en.wikipedia.org/wiki/CueCat) – I was impressed and inspired at that time but in my view it had two major weaknesses: (1) technically too early and (2) encoding of serial numbers instead of URLs. The RadioShack catalog and the Wired Magazine that included codes showed the potential – but it was too cumbersome as it was restricted to the PC …

We did some work on the topic, too around that time – at RFID reader integrated in a glove – which resulted in a Poster at ISWC [4] and a patent [5].

[1] Want, R. 2006. An Introduction to RFID Technology. IEEE Pervasive Computing 5, 1 (Jan. 2006), 25. DOI= http://dx.doi.org/10.1109/MPRV.2006.2

[2] Harrison, B. L., Fishkin, K. P., Gujar, A., Portnov, D., and Want, R. 1999. Bridging physical and virtual worlds with tagged documents, objects and locations. In CHI ’99 Extended Abstracts on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, May 15 – 20, 1999). CHI ’99. ACM, New York, NY, 29-30. DOI= http://doi.acm.org/10.1145/632716.632738

[3] Ljungstrand, P. and Holmquist, L. E. 1999. WebStickers: using physical objects as WWW bookmarks. In CHI ’99 Extended Abstracts on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, May 15 – 20, 1999). CHI ’99. ACM, New York, NY, 332-333. DOI= http://doi.acm.org/10.1145/632716.632916

[4] Schmidt, A., Gellersen, H., and Merz, C. 2000. Enabling Implicit Human Computer Interaction: A Wearable RFID-Tag Reader. In Proceedings of the 4th IEEE international Symposium on Wearable Computers (October 18 – 21, 2000). ISWC. IEEE Computer Society, Washington, DC, 193. (Poster as large PNG)

[5] US Patent 6614351 – Computerized system for automatically monitoring processing of objects. September 2, 2003. http://www.patentstorm.us/patents/6614351/description.html

Ubicomp Spring School in Nottingham – Tutorial

The ubicomp spring school in Nottingham had an interesting set of lectures and practical sessions, including a talk by Turing Award winner Robin Milner on a theoretical approach to ubicomp. When I arrived on Tuesday I had the chance to see Chris Baber‘s tutorial on wearable computing. He provided really good examples of wearable computing and its distinct qualities (also in relation to wearable use of mobile phones). One example that captures a lot about wearable computing is an adaptive bra. The bra one example of a class of interesting future garments. The basic idea is that these garments detects the activity and changes their properties accordingly. A different example in this class is a shirt/jacket/pullover/trouser that can change its insulation properties (e.g. by storing and releasing air) according to the external temperature and the users body temperature.

My tutorial was on user interface engineering and I discussed: what is different in creating ubicomp UIs compared to traditional user interfaces. I showed some trends (including technologies as well as a new view on privacy) that open the design space for new user interfaces. Furthermore we discussed the idea about creating magical experiences in the world and the dilemma of user creativity and user needs.

There were about 100 people the spring school from around the UK – it is really exciting how much research in ubicomp (and somehow in the tradition of equator) is going on in the UK.

Teaching, Technical Training Day at the EPO

Together with Rene Mayrhofer and Alexander De Luca I organized a technical training at the European Patent Office in Munich. In the lectures we made the attempt to give a broad overview of recent advanced in this domain – and preparing such a day one realizes how much there is to it…. We covered the following topic:
  • Merging the physical and digital (e.g. sentient computing and dual reality [1])
  • Interlinking the real world and the virtual world (e.g. Internet of things)
  • Interacting with your body (e.g. implants for interaction, brain computer interaction, eye gaze interaction)
  • Interaction beyond the desktop, in particular sensor based UIs, touch interaction, haptics, and Interactive surfaces
  • Device authentication with focus on spontaneity and ubicomp environments
  • User authentication focus on authentication in the public 
  • Location-Awareness and Location Privacy
Overall we covered probably more than 100 references – here are just a few nice ones to read: computing tiles as basic building blocks for smart environments [2], a bendable computer interface [3], a touch screen you can also touch on the back side [4], and ideas on phones as basis for people centric censing [5].
[1] Lifton, J., Feldmeier, M., Ono, Y., Lewis, C., and Paradiso, J. A. 2007. A platform for ubiquitous sensor deployment in occupational and domestic environments In Proceedings of the 6th Conference on international information Processing in Sensor Networks (Cambridge, Massachusetts, USA, April 25 – 27, 2007). IPSN ’07. ACM, New York, NY, 119-127. DOI= http://doi.acm.org/10.1145/1236360.1236377
[2] Naohiko Kohtake, et al. u-Texture: Self-organizable Universal Panels for Creating Smart Surroundings. The 7th Int. Conference on Ubiquitous Computing (UbiComp2005), pp.19-38, Tokyo, September, 2005. http://www.ht.sfc.keio.ac.jp/u-texture/paper.html
[3] Schwesig, C., Poupyrev, I., and Mori, E. 2004. Gummi: a bendable computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria, April 24 – 29, 2004). CHI ’04. ACM, New York, NY, 263-270. DOI= http://doi.acm.org/10.1145/985692.985726 
[4] Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. 2007. Lucid touch: a seethrough mobile device. InProceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07 – 10, 2007). UIST ’07. ACM, New York, NY, 269-278. DOI= http://doi.acm.org/10.1145/1294211.1294259 
[5] Campbell, A. T., Eisenman, S. B., Lane, N. D., Miluzzo, E., Peterson, R. A., Lu, H., Zheng, X., Musolesi, M., Fodor, K., and Ahn, G. 2008. The Rise of People-Centric Sensing. IEEE Internet Computing 12, 4 (Jul. 2008), 12-21. DOI= http://dx.doi.org/10.1109/MIC.2008.90  

Final Presentation: Advertising 2.0

Last term we ran an interdisciplinary project with our MSc students from computer science and business studies to explore new ways in outdoor advertising. The course was jointly organized by the chairs: Specification of Software Systems, Pervasive Computing and User Interface Engineering, and Marketing and Trade. We were in particular interested what you can do with mobile phones and public displays. It is always surprising how much a group of 10 motivated students can create in 3 months. The group we had this term was extraordinary – over the last weeks they regularly stayed in the evenings longer in the lab than me 😉

The overall task was very open and the students created a concept and than implemented it – as a complete system including backend server, end user client on the mobile phone, and administration interface for advertisers. After the presentation and demos we really started thinking where we can deploy it and who the potential partners would be. The system offers means for implicit and explicit interaction, creates interest profiles, and allows to target adverts to groups with specific interest. Overall such technologies can make advertising more effective for companies (more precisely targeted adverts) and more pleasant for consumers (getting adverts that match personal areas of interest).

There are more photos of the presentation on the server.

PS: one small finding on the side – Bluetooth in its current form is a pain for interaction with public display… but luckily there are other options.

Design Ideas and Demos at FH Potsdam

During the workshop last week in Potsdam we got to see demos from students of Design of Physical and Virtual Interfaces class taught by Reto Wettach and JennyLC Chowdhury. The students had to design a working prototype of an interactive system. As base technology most of them use the Arduino Board with some custom made extensions. For a set of pictures see my photo gallery and the photos on flickr. It would need pages to describe all of the projects so I picked few…

The project “Navel” (by Juan Avellanosa, Florian Schulz and Michael Härtel) is a belt with tactile output, similar to [1], [2] and [3]. The first idea along this lines that I have tried out was Gentle Guide [4] at mobile HCI 2003 – it seemed quite compelling. The student project proposed one novel application idea: to use it in sport. That is quite interesting and could complement ideas proposed in [5].

Vivien’s favorite was the vibrating doormat; a system where a foot mat is constructed of three vibrating tiles that can be controlled and different vibration patters can be presented. It was built by Lionel Michel and he has several ideas what research questions this could address. I found especially the question if and how one can induce feelings and emotions with such a system. In the same application context (doormat) another prototype looked at emotions, too. If you stroke or pat this mat it comes out of its hiding place (Roll-o-mat by Bastian Schulz).

There were several projects on giving everyday objects more personality (e.g. a Talking Trashbin by Gerd-Hinnerk Winck) and making them emotional reactive (e.g. lights that reacted to proximity). Firefly (by Marc Tiedemann) is one example how reactiveness and motion that is hard to predict can lead to an interesting user experience. The movement appears really similar to a real firefly.

Embedding Information has been an important topic in our research over the last years [6] – the demos provided several interesting examples: a cable that visualized energy consumption and keyboard to leave messages. I learned a further example of an idea/patent application where information is included in the object – in this case in a tea bag. This is an extreme case but I think looking into the future (and assuming that we get sustainable and bio-degradable electronics) it indicates an interesting direction and pushing the idea of Information at your fingertip (Bill Gates Keynote in 1994) much further than originally intended.

For more photos see my photo gallery and the photos on flickr.

[1] Tsukada, K. and Yasumrua, M.: ActiveBelt: Belt-type Wearable Tactile Display for Directional Navigation, Proceedings of UbiComp2004, Springer LNCS3205, pp.384-399 (2004).

[2] Alois Ferscha et al. Vibro-Tactile Space-Awareness . Video Paper, adjunct proceedings of Ubicomp2008. Paper. Video.

[3] Heuten, W., Henze, N., Boll, S., and Pielot, M. 2008. Tactile wayfinder: a non-visual support system for wayfinding. In Proceedings of the 5th Nordic Conference on Human-Computer interaction: Building Bridges (Lund, Sweden, October 20 – 22, 2008). NordiCHI ’08, vol. 358. ACM, New York, NY, 172-181. DOI= http://doi.acm.org/10.1145/1463160.1463179

[4] S.Bosman, B.Groenendaal, J.W.Findlater, T.Visser, M.de Graaf & P.Markopoulos . GentleGuide: An exploration of haptic output for indoors pedestrian guidance . Mobile HCI 2003.

[5] Mitchell Page, Andrew Vande Moere: Evaluating a Wearable Display Jersey for Augmenting Team Sports Awareness. Pervasive 2007. 91-108

[6] Albrecht Schmidt, Matthias Kranz, Paul Holleis. Embedded Information. UbiComp 2004, Workshop ‘Ubiquitous Display Environments’, September 2004

What happens if Design meets Pervasive Computing?

This morning I met with Claudius Lazzeroni, a colleague from Folkwang Hochschule (they were part of our University till two years ago).
 
They have different study programs in design and art related subjects. He showed me some projects (http://www.shapingthings.net/ – in German but lots of pictures that give you the idea). Many of the ideas and prototypes related to our work and I hope we get some joint projects going. I think it could be really exciting to have projects with design and computer science students – looking forward to this!
When I was in the UK we collaborated in the equator project with designers – mainly Bill Gaver and his group – and the results were really exciting [1]. We build a table that reacted to load changes on the surfaces and allowed you to fly virtually over the UK. The paper is worthwhile to read – if you are in a hurry have a look at the movie about it on youtube: http://www.youtube.com/watch?v=uRKOypmDDBM
There was a further project with a table –  a key table – and for this one there more funny (and less serious?) video on youtube: http://www.youtube.com/watch?v=y6e_R5q-Uf4
[1] Gaver, W. W., Bowers, J., Boucher, A., Gellerson, H., Pennington, S., Schmidt, A., Steed, A., Villars, N., and Walker, B. 2004. The drift table: designing for ludic engagement. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (Vienna, Austria, April 24 – 29, 2004). CHI ’04. ACM, New York, NY, 885-900. DOI= http://doi.acm.org/10.1145/985921.985947

Mechanical Computing, Beauty of Calculating Machines

Instead of covering the history of calculating machines in the DSD lecture, we took the train and went to the Arithmeum in Bonn to the see the artefacts live and to play with some of them.
We started with early means for counting and record keeping. The tokens and early writings did not use numbers as abstract concepts, rather as representatives of concrete objects – this is very inspiring, especially from a tangible interaction point of view. The knots, as used in south America, show impressively how the tools for calculation have to fit the context people live in. Interestingly all these artefacts highliht how the ability to calculate and store information is related to the ability to do trade – quite a good motivation for the setup we have in Essen business studies and computer science within one faculty.
I was again impressed by the ingenuity by the early inventers of calculating tools and machines. There is an interesting separation between calculating tools and machines – the first ones require the user to take care of the carry and the second do it by themselves. We tried out replicas of Napier’s calculating tool and Schickard’s calculating machine.
The beauty and the mechanical precision required of those early machines is impressive. These prototypes (most of them took years and massive funds to be built complete) can teach us something for research today. These inventors had visions and the will to get it implemented, even without a clear application or business model in mind. They were excited by the creating of systems than can do things, machines could not do before. From the professions of the inventors (e.g. Philipp Matthäus Hahn was a clergyman)  it becomes apparent that at these times some considered religion and calculation as closely related – which to mondern understanding is very very alien.

Seeing the Hollerith machine that was used for the US census more than 100 years ago can teach you a lot about data processing. Punch cards, electrical reading and electrical counters (using mainly relays) were the basis for this technology. Looking at the labels on the counters showed that the US has a long tradition in collecting data that is after some time is not seen as political correct 😉
Having learned binary calculations during the DSD course it was nice to see a machine that did binary additions, using small steel balls and gravity. On each place (1,2,4,8, …) there is space for one ball. If a second one comes to this place one moves up to the next place (carry) and one is discarded. This is implemented with very simple mechanics and the working prototype (recently build) is based on designs of Schickard (but he never built – if I am correct).
Moving on with binary systems and finally to silicon, we got to see the Busicom 141 – a desk calculator that uses the Intel 4004. It is impressive to see that this is not even 40 years ago – starting with 2300 transistors and 180kHz. 
you can find the full set of photos at: http://foto.ubisys.org/dsd0809/

One Ez430-F2013 for each student in DSD

This term we teach digital system design and besides the essential (gates, flip-flops, 2-complements, alu, data path, etc) we decided to include some practical parts. In the first part we introduced Verilog. We did the exercises with Icarus Verilog (free, text-based verilog) and there are more powerful tools available, e.g. ISE WebPACK.

In the second part we have practical exercises in assembly language using the Ez430-F2013 development kit. We borrowed one kit to each student (just in case someone is bored over Christmas) and the current task is to complete and assembly program (incomplete sample) that the LED shows repeatedly “Hello” in Morse code. This is just the start – perhaps we do some more interesting stuff in January. The development kit is really interesting – especially given the fact that it is only 20€ (including hardware, compiler, and IDE). The MCU is small – but still good enought to generate a video signal (eagle CAD files, some assembly code). 

Exporting your cars information to the mobile phone

In our user interface engineering class one of the tasks in the exercise is to create a concept design for providing information from the car on the mobile phone (e.g. millage, amount a fuel in the car, next service date, alram status, etc). The first part is to assess what information could be made accessible and what value it would create for the user. 
Today I came across a device (Tyredog TD-1000A) that is concerned with a one sub-part of this scenario: checking your pressure in the tires of the car. It is a simple sensor system, screwed on to each of the tires, connected to a wireless receiver. There is also a version that includes features for the car alarm (Tyredog TD-3000A).
Another group is looking yet again into the domain of  restaurant finders or more general night life. Apropos restaurant finders, Saturday night we got out of the subway onto union square and discussed where to go for dinner (an we probably looked disoriented). A local lady stoped and recommended the Union Square Café – and it was just great… sometimes just talking to someone in the street may provide you with an excellent alternative to technologies 😉 Perhaps the students find a solution that can reflect personal recommendations well…

History and Future of Computing and Interaction

Today I was teaching my class on user interface engineering and we covered a selected history of HCI and looked at the same time at a potential future. We discussed how user interface evolved and where UI revolutions have happed. To my question “What is the ultimate user interface?” I got three very interesting answers (1) a keyboard, (2) mind reading, and (3) a system that anticipates what I want. 
With regard to history in HCI one of my favorite texts is the PhD dissertation of Ivan Sutherland [1]. The work described was done in 1960-1963 when the idea of personal computing was very far from main stream. Even just browsing some of the pages gives an impression of the impact the work had…
For future user interfaces we talked about brain computer interfaces (BCI) and how they very much differ from the idea of mind reading. I came across a game controller – Mindlink – developed by Atari (1984) and that was never released [2]. It was drawing on the notion of linking to the mind but in fact it only measured muscle activity above the eye brows and apparently did not perform very well. However there is a new round coming up for such devices, see [3] for a critical article on consumer BCI.
On the fun side I found a number of older videos that look at future technology predictions- see the videos for yourself:
http://www.paleofuture.com one is a site that has an amazing (and largely funny) selection of predictions. There is a more serious – but nevertheless – very entertaining article on predictions for computing and ICT by Friedemann Mattern: Hundert Jahre Zukunft – Visionen zum Computer- und Informationszeitalter (hundred years future – predictions of the computing and information age) [4].
[1] Sutherland’s Ph.D. Thesis, Sketchpad, A Man-Machine Graphical Communication System. 1963 http://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-574.pdf
[3] Emmet Cole. Direct Brain-to-Game Interface Worries Scientists. Wired. 09.05.07. http://www.wired.com/medtech/health/news/2007/09/bci_games
[4] Friedemann Mattern.Hundert Jahre Zukunft – Visionen zum Computer- und Informationszeitalter. Die Informatisierung des Alltags – Leben in smarten Umgebungen, Springer Verlag 2007. http://www.vs.inf.ethz.ch/publ/papers/mattern2007-zukunft.pdf

Ideas in Advertisment, Privacy, German Law

In our master course we offer a project on pervasive advertisement (it is an interdisciplinary course project from computer science and marketing) where we look at future forms of advertisement that become possible by new technologies.
The students presented a set of really exciting ideas – an I would expect (if they get some of their ideas implemented) that advertising will be more entertaining and fun in the future. For some of the ideas we discussed potential privacy issues and I promised to provide later the reference to the German privacy law that restricts the use of optical/camera devices in public spaces. The German law is at a first glance very restrictive with regard to using cameras in public spaces. In short it can be summarized that data can only obtained for a legitimate, concrete and defined purpose and that the privacy interest of the people are not higher to value as the purpose. Additionally it has to be clear to the person observed that he or she is observed. (We probably need a lawyer to figure out what is allowed 😉 In [1] the text of the law (in German) can be found.

We presented MirrorBoard at Mensch und Computer 2008 in Lübeck

Last winter term I was teaching a class on Unconventional User Interfaces at the University of Linz as part of the MSc in Pervasive Computing. As part of the exercises the students had to do a project and write a paper on the topic in a group. This required to do a full round in the development (from idea creation to study).

Florian König and his group had an exciting idea for a novel form of advertisement. The user is mirrored in the advert and becomes a part of it. They implemented an interactive poster for a travel agent (users become part of the holyday scene) and tested it in-situ. The paper was accepted at the German HCI conference (Mensch und Computer) and Florian presented it today very well [1].

In the questions there was much discussion about privacy and user acceptance. We discussed whether or not such a installation would be legal in Germany (people mentioned the Datenschutzgesetz §6).

[1] Johannes Schönböck, Florian König, Gabriele Kotsis, Dominik Gruber, Emre Zaim, Albrecht Schmidt. MirrorBoard – An Interactive Billboard. Mensch und Computer 2008. Lübeck. Oldenbourg Verlag, 2008, p 207-216.

Innovative in-car systems, Taking photos while driving

Wolfgang just sent me another picture (taken by a colleague of him) with more information in the head-up display. It shows a speed of 180 km/h and I wonder who took the picture. Usually only the driver can see such a display 😉

For assistance, information and entertainment systems in cars (an I assume we could consider taking photos an entertainment task) there are guidelines [1, 2, 3] – an overview presentation in German can be found in [4]. Students in the Pervasive Computing class have to look at them and design a new information/assistance system that is context aware – perhaps photography in the car could be a theme… I am already curious about the results of the exercise.

[1] The European Statement of Principles (ESoP) on Human Machine Interface in Automotive Systems
[2] AAM Guidelines
[3] JAMA Japanese Guidelines
[4] Andreas Weimper, Harman International Industries, Neue EU Regelungen für Safety und Driver Distraction

(thanks to Wolfgang Spießl for sending the references to me)

Invited Lecture at CDTM, how fast do you walk?

Today I was at CDTM in Munich (http://www.cdtm.de/) to give a lecture to introduce Pervasive Computing. It was a great pleasure that I was invited again after last year’s visit. We discussed no less than how new computing technologies are going to change our lives and how we as developers are going to shape parts of the future. As everyone is aware there are significant challenges ahead – one is personal travel and I invited students to join our summer factory (basically setting up a company / team to create a news mobility platform). If you are interested, too drop me a mail.

Over lunch I met with Heiko to discuss the progress of his thesis and fishing for new topics as they often come up when writing 😉 To motivate some parts of his work he looked at behavioral research that describes how people use their eyes in communication. In [1] interesting aspects of human behavior are described and explained. I liked the page (251) with the graphs on walking speed as a function of the size of city (the bigger the city the faster people walk – it includes an interesting discussion what this effect is based on) and the eye contacts made dependent on gender and size of town. This can provide insight for some projects we are working on. Many of the results are not surprising – but it is often difficult to pinpoint the reference (at least for a computer science person), so this book may be helpful.

[1] Irenäus Eibl-Eibesfeldt. Die Biologie des menschlichen Verhaltens: Grundriss der Humanethologie. Blank; Auflage: 5. A. Dezember 2004.

Booting a start-up to teach?

We made our plans for setting up a company for creating a unique learning experience more specific. Uwe Bayer from Fraunhofer IAIS used in our discussion the phrase “don’t play to run company – really run a company” – which I think describes the essences of we would like to achieve. We plan to have some detailed information (and the recruitment process) out by the end of the month. If you are a student close to finishing your studies AND you have academic skills in your subject AND you have the drive to create a start-up THEN you should contact me in the beginning of June – we look for about 20 people with IT and business background that like to take a risk!

Teacher Training: mobile phone programming in JAVA

Yesterday evening we organized a teacher training session on JAVA programming for mobile phone. We introduced them to the basics of Java ME and gave a tutorial on using Netbeans with mobility pack for creating applications. One idea for using the phone as an application platform is to increase motivation.

In some of the discussions we came across the issue of “how to teach programming” in school. I personally thing that explaining and learning the basic concepts of statement, variable, if-then, and loop is best done with not much around… I showed some of the activities on the OLPC for programming: Pippy (http://wiki.laptop.org/go/Pippy) and Turtle Art (http://wiki.laptop.org/go/Turtle_Art) and we talked about processing (http://www.processing.org/) as a further option.

Project management, Visit to sd&m

Running successful (large scale) projects in computer science is a great challenge – very often projects are delayed and run over budget. As we aim to provide our students with all it takes to be successful in the job we have a mandatory course on project management for IT project in the BSc Systems Engineering curriculum.

This afternoon we visited sd&m (part of Capgemini) in Düsseldorf to talk about the course structure and content. We are delighted that Gebhard Ritter and Oliver Stoll, both having long term experience in managing large projects, teach the course this term again. Having been myself in some of the lectures last term I became again aware how much our students can benefit from such cooperation between university and industry.

OLPC – new interface guidelines – no file menu

We have tried several of the applications (called activities) and the basic functions seem OK. Vivien liked it and was quite curious to explore it further. The photos you can take with the built-in camera are similar in quality to a good web cam.

After discussing the Microsoft Vista interface guide in the last week of our course on User Interface Engineering it was really interesting to see the OLPC/Sugar user interface guidelines. Especially the shift away from save/open to keep and the journal are enormous changes (and hence probably quite hard for people who have used computers – obviously it is not really designed for them).

Using the measure activity provides basic tools for electronics measurements. The microphone input can be used as a simple oscilloscope and the USB port provides 1A – this makes it really interesting for experimenting, see the hardware reference.

Finishing the course User Interface Engineering for this term

No we had the last lectures of the course User Interface Engineering for this term. We will have oral exams stating later this month. The whole set of slides I used over the term (a bit more than 800) are available on our website. This year we have the first time made a set of questions to assist revising the material. In total we have about 200 questions – and looking over the questions it is really interesting that user interface design is not as trivial as one thinks (after teaching it for several years 😉

Prototypes of unconventional user interfaces

In Linz the students of the course unconventional user interfaces showed their first set of functional prototypes. The topics are related to interactive mirrors, context-aware advertisement posters, healthy rear-seat entertainment, and text input while driving. The assignment was to create a system that allows creating an authentic user experience for the concept. The technical solutions were very different and ranged from a dismantled keyboard to a system using a micro-controller, from a two-way mirror with display behind to direction detection in front of an advert. Even though the prototypes were fairly simple most of them showed impressively how much of an idea a functional prototype can transport.