Author: admin

Have Not Changed Profession – Hospitals are complex

admin

This morning we had the great opportunity to observe and discuss workflows and work practice in the operating area in the Elisabeth hospital in Essen. It was amazing how much time from (really busy) personnel we got and this provided us with many new insights.

The complexity of scheduling patients, operations, equipment and consumables in a very dynamic environment poses a great challenges and it was interesting to see how well it works with current technologies. However looking at the systems used and considering upcoming pervasive computing technologies a great potential for easing tasks and processes is apparent. Keeping tracking of things and people as well as well as documentation of actions are central areas that could benefit.

From a user interface perspective it is very clear that paper and phone communication play an important role, even in such high-tech environment. We should look a bit more into the Anoto Pen technology – perhaps this could be an enabler for some ideas we discussed. Several ideas that relate to implicit interaction and context awareness (already partly discussed in the context of a project in Munich [1]) re-surfaced. Similarly questions related to data access and search tools seem to play an interesting role. With all the need for documentation it is relevant to re-thing in what ways data is stored and when to analyses data (at storage time or at retrieval time).

One general message from such a visit is to appreciate people’s insight in these processes which clearly indicates that a user centered design process is the only suitable way to move innovation in such environments forward and create by this ownership and acceptance.

[1] A. Schmidt, F. Alt, D. Wilhelm, J. Niggemann, H. Feussner. Experimenting with ubiquitous computing technologies in productive environments. e & i Elektrotechnik und Informationstechnik, Springer Verlag. Volume 123, Number 4 / April, 2006. pages 135-139

Fraunhofer IAIS visiting Essen

admin

Today former colleagues from Fraunhofer IAIS visited the faculty of economics and computer science here in Essen. It was amazing how many topical connections we found between the research at IAIS and the work that is going on here in business studies, information system, and computer science. We discussed different options for future cooperation – in research and teaching – and I am very hopeful that we create interesting opportunities.

Last year, while still in Bonn, I organized summer @ IAIS. For this year we may go more interdisciplinary and set ourselves high goals… lets see.

GIBU meeting in Dagstuhl

admin

The week before Easter is the traditional time for the meeting of the GI group university professors (GIBU). GI (Gesellschaft für Informatik) is similar to the ACM, but on a national level. Due to other time constrains I was only able to be there for two days. We see that political aspects play more and more a role in our daily work life – if we like it or not it becomes essential to express our views with regard to computer science in Germany from a university perspective.

Besides this Dagstuhl (and in particular the wine cellar) is a good place to meet and to network. We discussed the option of doing a GI-Dagstuhl Seminar on novel user interface – let’s see if we find the time. To my surprise I met one of my professors during my undergaded studies from the University of Ulm – Prof. Uwe Schöning. His book on theoretical computer science (Theoretische Informatik – kurz gefasst, in German) got me really excite for the subject. It is really a great book to read – even if you don’t do theory.

DIY automotive UI design – or how hard is it to design for older people

admin 1 Comment

The picture does not show a research prototype – it shows the actual interior of a 5-series BMW (fairly recent model). The driver (an elderly lady) adapted the UI to suit her needs. This modification includes the labeling of controls which are important, writing some instructions for more complicate controls close to them (hereby implementing one of the key ideas of embedded information [1]), an covering some to the user “useless” controls.

At first I assumed this is a prank* – but it seems to be genuine and that makes it really interesting and carries important lessons with regard to designing for drivers of 80 years and older. Having different skins (and not just GUIs more in a physical approach) as well as UI components that can be composed (e.g. based on user needs) in the embedded and tangible domain seem challenging but may new opportunities for customized UIs. Perhaps investigating ideas for personalizing physical user interfaces – and in particular car UIs – may be an interesting project.

[1] Albrecht Schmidt, Matthias Kranz, Paul Holleis. Embedded Information. UbiComp 2004, Workshop ‘Ubiquitous Display Environments’, September 2004 http://www.hcilab.org/documents/EmbeddedInformationWorkshopUbiComp2004.pdf

* will try to get more evidence that it is real 🙂

Application Workshop of KDUbiq in Porto

admin

After having frost and snow yesterday morning in Germany being in Porto (Portugal) is quite a treat. The KDubiq application workshop is in parallel to the summer school and yesterday evening it was interesting to meet up with some people teaching there.

The more I learn about data mining and machine learning the more I see even greater potential in many ubicomp application domains. In my talk “Ubicomp Applications and Beyond – Research Challenges and Visions” I looked back at selected applications and systems that we have developed over the last 10 year (have a look at the slides – I, too was surprised what variety of projects we did in the last years ;-). So far we have often used basic machine learning methods to implement – in many cases creating a version 2 of these systems where machine learning research is brought together with ubicomp research and new technology platforms could make a real difference.

Alessandro Donati from ESA gave a talk “Technology for challenging future space missions” which introduced several challenges. He explained their approach to technology introduction into mission control. The basic idea is that the technology providers create together with the users a new application or tool. He strongly argued for a user centred design and development process. It is interesting to see that the concept of user centred development processes are becoming more widespread and go beyond classical user interfaces into complex system development.

User-generated tutorials – implicit interaction as basis for learning

admin

After inspiring discussions during the workshop and in the evening I reconsidered some ideas for automatically generated tutorials by user interaction. The basic idea is to capture usage of applications (e.g. using usa-proxy and doing screen capture) continuously – hard disks are nowadays big enough 😉 Using query mechanisms and data mining a user can ask for a topic and will then get samples of use (related to this situation). It creates some privacy questions but I think this approach could create a new approach to creating e-learning content…. maybe a project topic?

Advertising 2.0 – Presentation at CeBIT

admin

This morning I presented a short talk on new ways for outdoor advertisement at CeBIT. Based on results from interviews we know that shop windows and billboards are a well received medium. Similarly to measures we know from web logfiles I argue that it is interesting to have similar information on visitors, views, returns, durations for real world adverts.

The general approach we suggest is to use senor to measure activity – and as such measurements are incomplete there is need for data analysis and models. In two examples I show how this can be done using Bluetooth as sensing device. The slides (in German) are online.

TEI08 Proceedings in the ACM DL online, mandatory reading

admin

The proceedings of the 2nd international conference on Tangible and embedded interaction are online in the ACM digital library. Still not in the search index and with a few corrections to do…

Hiroshi Ishii contributed a paper on “Tangible bits: beyond pixels” – the first paper in the proceedings [1] and a great overview and introduction to the topic. If you are a student to start on tangible interaction or if you have students that start this paper is a mandatory reading!

[1] Ishii, H. 2008. Tangible bits: beyond pixels. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18 – 20, 2008). TEI ’08. ACM, New York, NY, xv-xxv. DOI= http://doi.acm.org/10.1145/1347390.1347392

CeBIT Demo – always last minute…

admin

Yesterday afternoon I was in Hannover at CeBIT to set up our part in a demo at the Fraunhofer stand (Hall 9, Stand B36). The overall topic of the fraunhofer presence is “Researching for the people“.

After some difficulties with our implementation on the phone, the server and the network (wired and wireless – my laptop showed more than 30 wifi-accesspoints and a BT-scan showed 12 devices) we got the demo going. The demo is related to outdoor advertisement and together with Fraunhofer IAIS we provide an approach to estimate the number viewers/visitors. On Wednesday I will give a talk at CeBIT to explain some more details.

It seems demo are always finished last minute…

Visiting the inHaus in Duisburg

admin

This morning we visited the inHaus innovation center in Duisburg (run by Fraunhofer, located on the University campus). The inHaus is a prototype of a smart environment and a pretty unique research, development and experimentation facility in Germany. We got a tour of the house and Torsten Stevens from Fraunhofer IMS showed us some current developments and several demos. Some of the demos reminded me of work we started in Lancaster, but never pushed forward beyond a research prototype, e.g. the load sensing experiments [1], [2].

The inHaus demonstrates impressively the technical feasibility of home automation and the potential of intelligent living spaces. However beyond that I strongly believe that intelligent environments have to move towards the user – embracing more the way people life their lives and providing support for user needs. Together with colleagues from Microsoft Research and Georgia Tech we organize the workshop Pervasive Computing at Home which is held as a part of Pervasive 2008 in Sydney that focuses on this topic.

Currently the market size for smart homes is still small. But looking at technological advances it is not hard to image that some technologies and services will soon move from “a luxury gadget” to “a common tool”. Perhaps wellness, ambient assistive living and home health care are initial areas. In this field we will jointly supervise a thesis project of one of our students over the next month.

Currently most products for smart homes are high quality, premium, high priced, and providing a long lifetime (typically 10 to 20 years). Looking what happened in other markets (e.g. navigation systems, now sold at 150€ retail prices including a GPS unit, maps, touch screen and video player) it seems to me there is definitely an interesting space for non-premium products in the domain of intelligent environments.

[1] Schmidt, A., Strohbach, M., Laerhoven, K. v., Friday, A., and Gellersen, H. 2002. Context Acquisition Based on Load Sensing. In Proceedings of the 4th international Conference on Ubiquitous Computing (Göteborg, Sweden, September 29 – October 01, 2002). G. Borriello and L. E. Holmquist, Eds. Lecture Notes In Computer Science, vol. 2498. Springer-Verlag, London, 333-350.

[2] Albrecht Schmidt, Martin Strohbach, Kristof Van Laerhoven, Hans-Werner Gellersen: Ubiquitous Interaction – Using Surfaces in Everyday Environments as Pointing Devices. User Interfaces for All 2002. Springer LNCS.

OLPC – new interface guidelines – no file menu

admin

We have tried several of the applications (called activities) and the basic functions seem OK. Vivien liked it and was quite curious to explore it further. The photos you can take with the built-in camera are similar in quality to a good web cam.

After discussing the Microsoft Vista interface guide in the last week of our course on User Interface Engineering it was really interesting to see the OLPC/Sugar user interface guidelines. Especially the shift away from save/open to keep and the journal are enormous changes (and hence probably quite hard for people who have used computers – obviously it is not really designed for them).

Using the measure activity provides basic tools for electronics measurements. The microphone input can be used as a simple oscilloscope and the USB port provides 1A – this makes it really interesting for experimenting, see the hardware reference.

OLPC – cute and interesting – but what type of computer is it?

admin

After the conference I had finally some time to try out my new XO Laptop (OLPC). It is fairly small, has a rubber keyboard and a very good screen. It can be used in laptop and e-book mode. A colleague described it as somewhere between a mobile phone and a notebook-computer – first I did not get it – but after using it I fully understand.

There is good documentation out – the getting started manual at laptop.org provides a very good entry point. Getting it up and running was really easy (finding the key for my WIFI-Access point at home was the most difficult part 😉

There are two interesting wikis with material online at olpcaustria.org and laptop.org. I am looking forward to trying the development environments supplied with the standard distribution (Pippy and Etoys).

I would expect when Vivien get up in the morning and sees it I will be second in line for exploring the XO further. It is really designed in a way that makes it attractive for children. To say more about about the usability (in particular the software) I need to explore it more…

To me it is not understandable why it is so difficult to get them in Europe. I think the buy 1 and donate 1 approach was very good (but again this was only in the US)…

Thought on Keys

admin

Many keys (to rooms and buildings) are still tangible objects, where the tangible properties and affordances imply certain ways of usage .Who has not gotten a hotel key that you hand in at reception, because it is too big to be carried in a pocket? Moving digital many keys we get lack craft and unique affordances as they are just plastic cards or RFID tags in a specific form. With moving towards biometric authentication it seems that the key is intangible (so we loose options in the design space) but embedded into us (which opens up new possibilities).

The major drawback of physical and tangible keys is that if you don’t have it with you – when you are in front of the door they can not help you. Even if you know where the key is and you communicate with the person having the key.
… but thinking back a few days to the visions in Hiroshi Ishii’s keynote its seems that this is very short term problem. Having atoms that can be controlled (tangible bits) we can just get the data for the key from remote and reproduce it locally. With current technology this seems already very feasible – on principle – ( some Person uses a 3D scanner, e.g. embedded in a mobile device that has a camera and communication) and the other person has a 3D printer/laser cutter. Still the question remains if moving to digital keys is not much easier.

However if you do not have the key – and even so there is a solution “on principle” – it does not really help 😉

Paul presented a paper on mobile phone interaction at TEI’08

admin

Paul Holleis presented at TEI’08 the results of the research he did during his internship at Nokia Research [1]. Over the summer Paul spent 3 month with Jonna Häkkila’s group in Helsinki, where he worked on two projects: combing touch and key-presses and wearable controls.

Technically both projects used capacitative sensing to recognize touch. In his paper “Studying Applications for Touch-Enabled Mobile Phone Keypads” [1] they added to common mobile phone buttons touch sensing so that multiple levels of interaction can be measured, such as approaching, touching and pressing. The paper additionally discusses new interaction possibility that arise from this.

[1] Paul Holleis, Jonna Häkkilä, Jussi Huhtala. Studying Applications for Touch-Enabled Mobile Phone Keypads. Proceedings of the 2nd Tangible and Embedded Interaction Conference TEI’08. February 2008.

Where are my things – Would Smart-its friends help in a real world scenario?

admin

At social events of conferences interesting things happen. One issue with a borrowed key reminded me of a paper that colleagues in the smart-its project wrote several years ago – smart-its friends [1]. The central idea was to have means to connect objects (make them friends) by a gesture interaction, which is detected by comparing acceleration values. Technically it is feasible and highly interesting, but I wonder about the real world applicability – but the missing key may be evidence for it…

[1] Holmquist, L. E., Mattern, F., Schiele, B., Alahuhta, P., Beigl, M., and Gellersen, H. 2001. Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts. In Proceedings of the 3rd international Conference on Ubiquitous Computing (Atlanta, Georgia, USA, September 30 – October 02, 2001). G. D. Abowd, B. Brumitt, and S. A. Shafer, Eds. Lecture Notes In Computer Science, vol. 2201. Springer-Verlag, London, 116-122.

Keynote by Prof. Ishii at TEI’08

admin

In the evening Prof. Hiroshi Ishii from the MIT Medialab presented a fascinating keynote at TEI’08. He gave an exciting overview of his work in tangible user interfaces, starting from tangible bits [1]. Right after the demos it was impressive to see how much impact he had on this area of research. He has a paper that accompanies the keynote in the proceedings, that will be soon available in the ACM DL.

On central piece of advice on research was to work on visions rather than on applications. He argues visions may last 100 years and applications are likely to be gone after 10. However he made the interesting connection between the two. You need to have applications to convey and communicate the visions, but you need to have the vision to create the applications. He had a great a slide (which indicates that we will go to heaven) to motivate to do something to be remembered in 200 years – not sure if this is my plan.

He criticized interdisciplinary research as we do it at the moment. In his few the most efficient way for interdisciplinary way is to make a single person knowledgeable in several fields. This raises issues in education and in the discussion afterwards there was the question whether this is feasible beyond the MIT or not.

[1] Ishii, H. and Ullmer, B. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, United States, March 22 – 27, 1997). S. Pemberton, Ed. CHI ’97. ACM, New York, NY, 234-241. DOI= http://doi.acm.org/10.1145/258549.258715

Talks, Demos and Poster at TEI’08

admin

The first day of the conference went well – thanks to many helping hands. The time we had for the demos seemed really long in the program but was too short to engage with every exhibit (for next year we should make sure to allocate even more time).

People made really last minutes efforts to make their demos work. We even went to Conrad electronics to get some pieces (which burned before in setting up the demos). Demos are in my eyes an extremely efficient means for communicating between scientists and sharing ideas.

New working group on tangible interaction

admin

This morning a new working group on tangible interaction in mixed realities (in German Be-greifbare Interaktion in Gemischten Wirklichkeiten) was established as part of the German Computer Science Society (GI). About 30 people from all over Germany gathered at B-IT in a pre-conference event to TEI’08. The group was interdisciplinary, including computer science, design, psychology, and pedagogic. The diversity of research projects as well as teaching programs in Germany in impressive.

Visit to the Arithmeum in Bonn

admin
For people who already arrive on Sunday, the day before the conference, we organised some museum visits: Arithmeum, Haus der Geschichte, Deutsches Museum, and Art Gallery. I only had time to see the Arithmeum (http://www.arithmeum.uni-bonn.de/) which was pretty impressive. Hiroshi Ishii (the keynote speaker of the conference) and Brygg Ullmer (last years conference co-chair) joined us, too.

It was unexpected how close the displayed artefacts are to our current research on tangible interaction. We had a very good guided tour by Nina Mertens, who gave us an interesting overview from counting tokens to calculation machines. Some of the exhibit we could even try out our selves.

I found the aspect of aesthetics in some of the calculation aids and machines quite fascinating. Especially the fact that some were so precious that they were not really used for calculating but more for showing off is a concept that is amazing. Similarly interesting was one artefact that was mainly built as a proof that calculation can be automated.

TEI08 Onside Preparation

admin

One of the fun parts of organizing a conference is to work with a team of student volunteers. It is always amazing how quick many hands can work! Today we met with some of the student volunteers to pack the bags and set up the poster and exhibition space. (Unexpectedly) we are well in time.

Press-releases for TEI’08 – explaining the idea

admin

We have two press releases to announce TEI’08 – the second international conference on tangible and embedded interaction (in German only).

The first one is a general announcement with the invitation to the press conference: Internationale Konferenz zu neuen Möglichkeiten der Mensch-Maschine-Interaktion

The second one is explaining – in non-scientific terms – the idea of tangible and embedded interaction: Der Wetterfrosch im Regenschirm

Visit at the TU Eindhoven

admin

Elise van den Hoven, the program co-chair of TEI08, organized the printing of the proceeding. We went there on Tuesday to collect the books – quite a heavy load! The books look really good and the cover is great.

In the afternoon I gave a lecture with the title “Interacting with Pervasive Computing Systems”. I have related some of our recent work and ideas to the focus of the course which is “intelligent systems, products and related services”. In particular I asked to re-think how we can find a balance between user needs and technology push – without compromising a fruitful user centred design and development process. We continued this discussion with prof. Berry Eggen at dinner in a quite nice restaurant in town.

A further issue in my talk was to design interactive products and services that they fit their purpose very well – but that beyond this they allow for creative use. As an example I showed a set of photos I took with my phone. Some are in categories (e.g. preserving memory) that were probably anticipated by the designers whereas others (e.g. a WIFI-access code with I took a photo of not to have it to write down) are creative use. This observation again leads to the previous discussion on technology push and user need.

Being still new to the Ruhrgebiet and having not brush up on regional geography I was very much surprised how close Eindhoven is to Essen. Perhaps there is a chance for more collaboration in the future.

Finishing the course User Interface Engineering for this term

admin

No we had the last lectures of the course User Interface Engineering for this term. We will have oral exams stating later this month. The whole set of slides I used over the term (a bit more than 800) are available on our website. This year we have the first time made a set of questions to assist revising the material. In total we have about 200 questions – and looking over the questions it is really interesting that user interface design is not as trivial as one thinks (after teaching it for several years 😉

Will cars become a more open platform?

admin

Today I met with Matthias Kranz in Munich. Besides discussing his thesis I got to see his new car (a prius) – quite impressive and interesting interfaces. Later I met with Wolfang Spießl who started recently his PhD in cooperation with BMW – again seeing an interesting and impressive (test)car.

It is really curious to see that there is a lot of interest in the hobbyist communities on car interfaces and protocols. In the June/2007 issues of Elektor (http://www.elektor.de/) was an article on a OBD-2-analyser, in a recent issue of the EAM (http://www.eam-magazin.de/) was a similar article and there are many community sites on the WWW, e.g. http://www.canhack.de/

Perhaps we could do in one of our pervasive computing related classes a project on this topic? There are so many technical opportunities and the challenge is to find the convincing applications!

Reminded of the Ubicomp Vision

admin

Today I was reminded of a discussion in 1998 on the implications of computing technologies becoming cheaper and cheaper. Even then it seemed inevitable that many artifacts will include computational and perceptual qualities. The discussion was in the context of the European project TEA (technology for enabling awareness) where we built a context-aware phone [1]. Walter van de Velde suggested imagining that processors, sensors, communication will only cost cents (or will be virtually free as part of the production process) and we worked on the question: what products and services will emerge? One generic answer then was than any product of a value 20$ and above will include computing and sensing capabilities, if there is any (even a minimal) advantage achieved by this.

Michael Beigl made it more concrete and found coffee mugs (which were more than 20$ each) and attached a processor, communication and sensors. The MediaCup [2] showed several interesting results and underlined that such approach makes sense if there is an advantage.

Today I saw in an office of a former colleague in Munich two objects that had perceptual qualities and output (not really processing yet). One object is a plastic toad that makes a noise when you move and the other is a rubber pig that makes a noise when you open the fridge (reacts on change in level, but did not work). This made me wonder if we were only partially right – yes objects will have sensors included, yes there will be processing, but no there is no need that it makes sense. Or perhaps having it as a gadget is advantage enough…

[1] Schmidt, A., Aidoo, K. A., Takaluoma, A., Tuomela, U., Laerhoven, K. V., and Velde, W. V. 1999. Advanced Interaction in Context. In Proceedings of the 1st international Symposium on Handheld and Ubiquitous Computing (Karlsruhe, Germany, September 27 – 29, 1999). H. Gellersen, Ed. Lecture Notes In Computer Science, vol. 1707. Springer-Verlag, London, 89-101. DOI= http://dx.doi.org/10.1007/3-540-48157-5_10

[2] Gellersen, H. W., Schmidt, A., and Beigl, M. 2002. Multi-sensor context-awareness in mobile devices and smart artifacts. Mob. Netw. Appl. 7, 5 (Oct. 2002), 341-351. DOI= http://dx.doi.org/10.1023/A:1016587515822

Sensing a common tools – when will it be integrated in building materials?

admin

This morning a heating and water technician checked on the wet spots on my wall in my new flat in Essen. Using a hygrometer he looked for the area which is most damp and then he broke a hole into the wall. After opening the wall, it was very easy to see that the outside wall is wet and that the heating is OK.

The hole in the wall does not really look good 🙁

This makes me wonder when building materials, with sensing included will move from the lab to the real world. Pipe insulation, plaster boards, stones with integrated sensors would be quite easy to create and there are ideas to do it in a cheap and easy way. In the context of Pin&Play (later Voodoo I/O) we explored some ideas but never completed the prototypes for real use. Perhaps this could be an interesting project…

Learntec – Session on pervasive computing

admin

I was today in Karlsruhe at Learntec, a trade fare and congress for technologies in learning, training and education. Alois Ferscha organized a session on pervasive computing and learning.

My talk was entitled “back to the roots – technologies for interweaving learning and experience”. I stared out with the question: What is the difference between an apple tree and a biology book. In essence my argument is that (1) first hand experience can not be replaced, (2) we need consolidated knowledge based on the experience to learn efficiently, and (3) pervasive computing technologies can bridge the gulf between them.

The slides of the talk “Zurück zum Ursprung – Technologien für die Verflechtung von Lernen und Erfahren” (in German) are available on my web page.

Interactive window displays – we have better ideas

admin 1 Comment
It seems that in the research community a lot of people are convinced of interactive public spaces and interactive window displays. Over the last month I have see great visions and ideas – as well as reflected on our own multi-touch ideas for interactive shop windows.

The installations I have seen in the real world however are at best boring (and often not functioning at all). It seems that even a student-project-lab-demo is more appealing and works at least as realiable.

Especially combining sensing (e.g. simple activity recognition, context) with low threshold interactive content seems to have great potential. If there is somebody interested in really cool stuff for a shop window (attention grabbing, eye catchers, interactive content, etc.) – talk to me. We are happy to discuss a project proposal 😉