Closing Keynote at AMI2011, Beyond Ubicomp – Computing is Changing the Way we Live

On Friday afternoon I had the privilege to present the closing keynote at AMI2011 in Amsterdam with the title ‘Beyond Ubicomp – Computing is Changing the Way we Live’. The conference featured research in Ambient Intelligence ranging from networking and system architecture to interfaces and ethnography. It brought an interesting set of people together and it was good to see many students and young researchers presenting their work.

In my closing keynote at talked about my experience of the last 13 years in this field and about a vision of the future. My vision is based on a basic technology assessment – basically looking what technologies will (in my view) definitely come over the next 20 years and looking at the implications of this. I stared out with a short reference to Mark Weiser’s now 20 year old article [1]. The upcoming issue of IEEE Pervasive Magazine will have a in-depth analysis of the last 20 years since Weiser’ article – we have also an article in there on how interaction evolved.

The vision part of the talk looked “Perception beyond there here and now” [2] from 3 different angles:

  • Paradigm Shift in Communication
    Here I argue that the default communication in the future will be public communication and only if something is secret we will try to use non public channel. First indicators of this are a switch from email to twitter and facebook. I used a cake baking example to highlight the positive points of this shift.
  • Steep Increase in media capture
    The second angle is just observing and extrapolating the increase in capture of media information. If you go already now on youtube you will information about many things (backing a cake, repairing a bike, etc.). The implication of this increase in media capture will be virtually unlimited access to experience other people share
  • Transformation of experienced perception
    The final angle is that this creates a new way of perceiving the world. We will extent perception beyond the here and now and this is bringing a completely new way of creating and accessing information. I used the example of enquiring about buying an international train ticket at the station in Amsterdam. If you can look there through other people’s eyes the question becomes trivial.

My overall argument is that we are in for a major transformation of our knowledge and information culture. I would expect that this shift is as radical as the shift from an oral tradition to the written societies – but the transition will be much quicker and in the context of a globalized and competitive world.

The main conclusion from this is: Ethics and values are the central design material of this century.

Looking at twitter it seems it got across to some in the audience 😉 If your are interested, too have a look at the slides from the keynote.

[1] Mark Weiser. The computer for the 21st century. Scientific American, Vol. 265, No. 3. (1991)
[2] Albrecht Schmidt, Marc Langheinrich, and Kritian Kersting. 2011. Perception beyond the Here and Now. Computer 44, 2 (February 2011), 86-88. DOI=10.1109/MC.2011.54 http://dx.doi.org/10.1109/MC.2011.54

NSF/EU workshop in Mannheim

Mohan Kumar and Marco Conti organized an EU/NSF workshop on Future Directions in Pervasive Computing and Social Networking for Emerging Applications. They managed to get together an interesting set of people and the discussion in the break out session were very enjoyable and I got a number of ideas what really are the challenges to come.

There are the position statements on the web page and at some point the identified grand challenges will be available.

PS: blackboards are still highly effective 😉

Will it be possible to keep data secret in the future?

At the moment there is an interesting discussion in Germany: should the state buy data (leaked out of a Swiss bank) that give details on people who have not paid their taxes in Germany. I will not add to the political discussion on that as there have been many arguments – some interesting and others funny. I am only amused about a small party that is very much against it. But one has to be fair – this is after all an indicator that democracy works 😉 parties represent the interests of their voters…

I think on a more general scale this incident and similar current cases could be an indicator of a future where everything that is on (electronic) file is likely to become public, given that there is an interest. One hundred years ago it was pretty difficult to steal or copy a few thousand data sets. You would have needed access to the archives for many nights and copying would have taken days. 30 years ago it would have been still hard – e.g. copying stacks of paper on a Xerox or using several large magnetic disks. Over recent years it has become much easier – a memory card is fairly small and a digital camera to copy documents is in many current mobile phones. It seems that if someone has rightful access to data (at a certain point in time) it may proof very hard to keep them from making a copy – may it be by copying the data digitally or by capturing electronically what they see. And hiding a SD-card is much more trivial than a car load of paper.

And as we know technology is progressing – perhaps we will get laws that restrict how small the physical size of a memory device can be 😉 And there is always a party who will lobby for it…

Energy Harvesting – wireless power?

Since a wireless charger (RCA Airnergy) was announces at CES that harvests energy from wifi signals that are around the topic is everywhere in the (tech) news. It is an exciting prospective to imagine mobile devices that will recharge themselves from the environment they are in. However I am not sure how well harvesting energy from RF will worked in regular environments – not saturated with radio signals.

The topic is really exciting – and in the end people probably do not care much if the energy is harvested from their movement, from light, temperature or RF – as long as it works. There is a introductory article to energy harvesting by Joe Paradiso and Thad Starner [1] which is worthwhile to read.

[1] Joseph A. Paradiso, Thad Starner, “Energy Scavenging for Mobile and Wireless Electronics,” IEEE Pervasive Computing, vol. 4, no. 1, pp. 18-27, Jan.-Mar. 2005, doi:10.1109/MPRV.2005.9

The next big thing – let’s look into the future

At Nokia Research Center in Tampere I gave a talk with the title “Computing Beyond Ubicomp – Mobile Communication changed the world – what else do we need?“. My main argument is that the next big thing is a device that allows us to predict the future – on a system as well as on a personal level. This is obviously very tricking as we have a free will and hence the future is not completely predictable – but extrapolating from the technologies we see now it seems not farfetched to create a device that enables predictions of the future in various contexts.

My argument goes as follows: the following points are technologically feasible in the near future:

  1. each car, bus, train, truck, …, object is tracked in real-time
  2. each person is tracked (location, activity, …, food intake, eye-gaze) in real-time
  3. environmental conditions are continuously sensed – globally and locally sensed
  4. with have a complete (3D) model of our world (e.g. buildings, street surface, …)

Having this information we can use data mining, learning, statistics, and models (e.g. a physics engine) to predict the future. If you wonder if I forget to thing about privacy – I did not (but it takes longer to explain – in short: the set of people who have a benefit or who do not care is large enough).

Considering this it becomes very clear that in medium term there is a great potential in having control over the access terminal to the virtual world, e.g. a phone… just thing how rich your profile in facebook/xing/linkedin can be if it takes all the information you implicitly generate on the phone into account.

Information vs. Mobility, Percom PC meeting in New York

The PC meeting for Percom 2009 took place at IBM in Hawthorne, NY. Percom had about 200 submissions and many good ones – so we could compile an exciting program across the whole field of pervasive computing and communication. As one of three program vice chairs I have looked in detail in about 1/3 of the submissions that were application related. It is interesting to observe that research as a whole in the field becomes more major and at the same time more incremental. 

To me this puts up the big question in which domains will the new big innovations happen, what is the next trend after we have pervasive computing? There are luckily plenty of options, but at the moment it seems that there develops an interesting relationship between information, communication, mobility and energy. It seems that we can compensate mobility by information and communication and similarly we can reduce energy required by information available. One example is: if I know where things are (=information) I can reduce the effort required to find them (=mobility). Is there more to it?
Each time in the US – even in New York were public transport works quite well – one is surprise how alien it appears to many that it could be an option to take public transport on a business trip (e.g. there are no first class coaches on regional trains). Flying from Düsseldorf into Newark it was convenient to take the train to Penn Station in NY City and then an express train to White Plaines. If we would not have gone for a walk in the city we probably would have been equally fast as by car. With the again low gas prices in the US (less than 2U$ per gallon, down from 4 just a few month ago) I would expect public transport and small cars will not gain too much popularity – before the next rise in gas prices.

PS: it is amazing how many possiblities there are to serve coffee (and this is probably not one of the most environment friendly)

Keynote at MobileHCI2008: BJ Fogg – mobile miracle

BJ Fogg gave the opening keynote at mobile HCI 2008 in Amsterdam. The talk explained very well the concept of Captology (computers as persuasive technologies) and the newer projects are very inspiring. He put the following questions at the center: How can machines change people’s minds and hearts? How can you automate persuasion? His current focus is on behavior change.

He reported of a class he is teaching at Stanford on designing facebook applications. The metric for success (and on this students are marked) is the uptake of the created application over the time of the course. He reported that the course attracted 16 million users in total and about 1 million on a daily basis – that is quite impressive. This is also an example of the approach he advocates: “rather try than think”. The rational is to try out a lot of things (in the real market with real users, alpha/beta culture) rather than optimize a single idea. Here the background is that nowadays implementation and distribution is really easy and that the marked decides if it is hot or not… His advice is to create minimal application – simple application and then push it forward. All big players (e.g. google, flickr) have done it this ways…

With regard to the distribution methods for persuasion he referred over and over to social networks (and in particular facebook). His argument is that by these means one is able to reach many people in a trusted way. He compared this to the introduction of radio but highlighted the additional qualities. Overall he feels that Web 2.0 is only a worm up for all the applications to come on the mobile in the future.

At the center of the talk was that prediction that mobile devices will be within 15 years the main technology for persuasion. He argued that mobile phones are the greatest invention of human kind – more important than the writing and transportation systems (e.g. planes, cars). He explained why mobile phones are so interesting based on three metaphors: heart, wrist watch, magic wand.

Heart – we love our mobile phones. He argued that if users do not have their phone with them they miss it and that this is true love. Users form a very close relationship with their phone and spend more time with the phone than with anything/anyone else. He used the image of “mobile marriage”…

Wrist watch – the phone is always by our sides. It is part of the overall experience in the real world provding 3 functions: Concierge (reactive, can be asked for advice, relationship base on trust), Coach (proactive, coach comes to me tells me, pushing advice), and Court Jester (entertains us, be amused by it, create fun with content that persuades).

Magic wand – phones have amazing and magical capabilities. A phone provides humans with a lot of capabilities (remote communication, coordination, information access) that empower many things.

Given this very special relationship it may be a supplement for our decision making (or more general our brain). The phone will advise us what to do (e.g. navigation systems tell us where to go) and we love it. We may have this in other areas, too – getting told what movie to see, what food to eat, when to do exercise, … not fully convinced 😉

He gave a very interesting suggestion how to design good mobile applications. Basically to create a mobile application the steps are: (1) Identify the essence of the application, (2) strip everything of the application that is not essential to provide this and (3) you have a potentially compelling mobile application. Have heard of this before, nevertheless it seems that still features sell but it could by a change with the next generation.

He provided some background on the basics of persuasion. For achieving a certain target behavior you need 3 things – and all at the same time: 1. sufficient motivation (they need to want to do it), 2. Ability to do what they want (you either have to train them or to make it very easy – making easer is better) and 3. a trigger. After the session someone pointed out that this is similar to what you have in crime (means, motive, opportunity 😉

For creating persuasive technologies there are 3 central pairs describing motivation:

  • Instant pleasure and gratification vs. instant pain
  • Anticipation of good or hope vs. anticipation of the bad or fear (it is noted that hope is the most important motivator
  • Social acceptance vs. social rejection

When designing systems it is essential to go for simplicity. He named the following five factors that influence simplicity: (1) money, (2) physical effort, (3) brain cycles, (4) social deviation, and (5) non-routine. Antonio pointed out that this links to work of Gerd Gigerenzer at MPI work on intuitive intelligence.

[1] Gigerenzer, G. Gut feelings: The intelligence of the unconscious. New York: Viking Press.

Hans Visited our Group, Issues on sustainable energy / travel

Hans Gellersen, who was my supervisor while I was in Lancaster, visited our lab in Essen. We discussed options for future collaborations, ranging from student exchange to joined proposals. Besides other topics we discussed sustainable energy as this is more and more becoming a theme of great importance and Pervasive Computing offers many building blocks towards potential solutions. Hans pointed me to an interesting project going on at IBM Hursley “The House That Twitters Its Energy Use“.

At the Ubicomp PC meeting we recently discussed the value of face-2-face meetings in the context of scientific work and it seems there are two future directions to reduce resource consumption: (1) moving from physical travel to purely virtual meetings or (2) making travel feasible based on renewable energies. Personally I think we will see a mix – but I am sure real physical meetings are essential for certain tasks in medium term. I am convinced that in the future we will still travel and this will become viable as travel based on renewable energies will become feasible. Inspiring example project are SolarImpulse (its goal is to create a solar powered airplane) and Helios (solar-powered atmospheric satellites). There are alternative future scenarios and an interesting discussion by John Urry (e.g. a recent article [1], a book – now on my personal reading list [2]). These analyses (from a sociology perspective) are informative to read and can help to create interesting technology interventions. However I reject the dark scenarios, as I am too much of an optimist trusting in peoples good will, common sense, technology research and engineering – especially if the funding is available ;-).

[1] John Urry. Climate change, travel and complex futures. The British Journal of Sociology, Volume 59, Issue 2, Page 261-279, Jun 2008

[2] John Urry. Mobilities. October 2007.

Ageing, Technology, Products, Services

Today and yesterday I am visiting a conference that is concerned with ageing – looking at the topic from different perspective (computer science, psychology, medicine, economics) run at the MPI in Berlin. The working group is associate with the the German Academy of Sciences Leopoldina and I was invited by Prof. Ulman Lindenberger who is director at the Max Planck Insititut and works in Lifespan Psychology. The working group is called ageing in Germany (in German).

Antonio Krüger and I represented the technology perspective with example from the domain of ubiquitous computing. My talk “ubiquitous computing in adulthood and old age” is a literature review in pictures of selected ubicomp systems targeted as an introduction to non-CS people to the domain. The discussions were really inspiring. In one talk Prof. Jim-Chern Chiou from National Chiao Tung Univeristy in Taiwan (the brain research lab) presented interesting dry electrodes that can be used for EEG – but also for other applications where one need electrodes.

Antonio reported an interesting experiment on the navigation/walking performance of people. The basic message is: if you are old and you can hold on to something while walking you gain cognitive resource – if you are young this effect is not given – has quite interesting impliciations [1]. Antonio worked on more in this domain, see [2].
Over lunch we discussed some ideas related to persuasive technologies and Ulman Lindenberg hinted me some relevant authors (Bargh, Gollwitzer) and I found an interesting manual on subliminal prime on the web.
[1] Martin Lövdén, Michael Schellenbach, Barabra Grossmann-Hutter, Antonio Krüger, Ulman Lindenberger: Environmental topography and postural control demands shape aging-associated decrements in spatial navigation performance. Psychology and Aging, 20, 683-694, 2005 http://www.ncbi.nlm.nih.gov/pubmed/16420142
[2] Aslan, I., Schwalm, M., Baus, J., Krüger, A., and Schwartz, T. 2006. Acquisition of spatial knowledge in location aware mobile pedestrian navigation systems. In Proceedings of the 8th Conference on Human-Computer interaction with Mobile Devices and Services (Helsinki, Finland, September 12 – 15, 2006). MobileHCI ’06, vol. 159. ACM, New York, NY, 105-108. DOI= http://doi.acm.org/10.1145/1152215.1152237

Keynote at Pervasive 2008: Mark Billinghurst

Mark Billinghurst presented an interesting history of augmented reality and he showed clearly that camera phones are the platform to look out for. He reminded us that currently the 3D performance of mobile phones is similar to the most powerful 3D graphics cards show 15 years ago at SIGGRAPH. Looking back at Steven Feiner’s backpack [1] – the first augmented reality system I saw – can tell us that we should not be afraid to create prototypes that may be a bit clumsy if they allow us to create a certain user experience and for exploring technology challenges.

In an example video Mark showed how they have integrated sensor information (using particle computers) into an augmented reality application. Especially for sensor-network applications this seems to create interesting user interface options.

One reference on to robust outdoor tracking done at Cambridge University [2] outlines interestingly how combining different methods (in this case GPS, inertial, computer vision and models) can move location techniques forward. This example shows that high precision tracking on mobile devices may not be far in the future. For our application led research this is motivating and should push us to be more daring with what we assume from future location systems.

Mark argue to look more for the value of experience – the idea is basically that selling a user experience is of higher value than selling a service or a technology. This view is at the moment quite common – we have seen this argument a lot at CHI2008, too. What I liked with Mark’s argument very much is that he sees it in a layered approach! Experience is at the top of a set of layers – but you cannot sell experience without having technology or services and it seems a lot of people forget this. In short – no experience design if you do not have a technology working. This is important to understand. He included an example of interactive advertisement (http://www.reactrix.com/) which is interesting as it relates to some of the work we do on interactive advertisement (there will more as soon as we have published our Mensch und Computer 2008 paper).

His further example on experience was why you value a coffee at Starbucks at 3€ (because of the overall experience) reminded me of a book I recently read – quite a good airline/park read (probably only if you are not an economist) – makes the world a bit understandable [3].
Build enabling technologies and toolkits as means to improve one’s citation count was one of Mark’s recommendations. Looking back at our own work as well as the work of the Pervasive/Ubicomp community there is a lot of room for improvement – but it is really hard to do it …

[1] S. Feiner, B. MacIntyre, T. Höllerer, and T. Webster, A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Proc. ISWC ’97 (First IEEE Int. Symp. on Wearable Computers), October 13-14, 1997, Cambridge, MA. Also in Personal Technologies, 1(4), 1997, pp. 208-217, http://www1.cs.columbia.edu/graphics/publications/iswc97.pdf, http://www1.cs.columbia.edu/graphics/projects/mars/touring.html

[2] Reitmayr, G., and Drummond, T. 2006. Going out: Robust model-based tracking for outdoor augmented reality. In Proceedings of IEEE ISMAR’06, 109–118.http://mi.eng.cam.ac.uk/~gr281/docs/ReitmayrIsmar06GoingOut.pdf, http://mi.eng.cam.ac.uk/~gr281/outdoortracking.html

[3] Book: Tim Harford. The Undercover Economist. 2007. (German Version: Ökonomics: Warum die Reichen reich sind und die Armen arm und Sie nie einen günstigen Gebrauchtwagen bekommen. 2006.)

Application Workshop of KDUbiq in Porto

After having frost and snow yesterday morning in Germany being in Porto (Portugal) is quite a treat. The KDubiq application workshop is in parallel to the summer school and yesterday evening it was interesting to meet up with some people teaching there.

The more I learn about data mining and machine learning the more I see even greater potential in many ubicomp application domains. In my talk “Ubicomp Applications and Beyond – Research Challenges and Visions” I looked back at selected applications and systems that we have developed over the last 10 year (have a look at the slides – I, too was surprised what variety of projects we did in the last years ;-). So far we have often used basic machine learning methods to implement – in many cases creating a version 2 of these systems where machine learning research is brought together with ubicomp research and new technology platforms could make a real difference.

Alessandro Donati from ESA gave a talk “Technology for challenging future space missions” which introduced several challenges. He explained their approach to technology introduction into mission control. The basic idea is that the technology providers create together with the users a new application or tool. He strongly argued for a user centred design and development process. It is interesting to see that the concept of user centred development processes are becoming more widespread and go beyond classical user interfaces into complex system development.

Pervasive Computing to Change Advertising in the Real World

It was great to spend some time chatting with Alois Ferscha and Gabi Kotsis in Linz. We discussed future forms of advertisement and it seems that it is very clear that pervasive computing technologies – ranging from new displays, to tracking and implicit and explicit interaction – will change our high streets (and any other place where we expect or don’t advertising) in the near future significantly. Looking at current installations we can already see that the race for grapping customer’s attention is on. Given the many ideas around I expect it will be quite exciting.

One interesting movie on youtube.com shows a pretty cool and novel form of advertising – beamvertising. The technology is simple (a projector mounted on a driving truck) but the effect looks pretty good! It is probably not legal but it shows interesting potential. I think interactive (outdoor) projections can be a real actor. Perhaps we should start talking to some companies to push our ideas for new forms of advertisement…

Talk at the expert meeting on RFID and ubicomp

In Frankfurt there was today an expert meeting on RFID and ubicomp organized by the Fraunhofer ISI. The purpose was a discussion about the impact of RFID technologies. The organizers will use our input to inform the creation of a document of technology assessment for the German parliament. The majority of the participants came from companies developing RFID technology or system.
In the first part of my talk “RFID and Beyond” I highlighted results from two workshops where I was a co-organizer: PTA2006 and Pertec2007 held at the Pervasive and Percom conferences. The results were also published in 2 papers in the IEEE Pervasive Computing magazine, see [1] and [2]. After this I showed some future visions and scenarios, namely the Smart-Its & MediaCup (foto from Birgit at Teco) [3], the SensorKnife [4], and the aware goods project [5]. Michael Müller extended the idea of the first aware goods project with a mobile phone based prototype – which we still have not written up for publication.

For me the technology assessment in Germany seems still often very much centred on threats and looks much less at opportunities. Looking at developments in Asia and in particular in Korea (e.g. U-City) I hope politics in Germany will in the future more often see the positive sides, too. Technology assessment can become a means to find opportunities and ideas to support innovation. For me it seems that a lot of the risks people attribute to RFID are not based on scientific results – is appears rather media induced… Positive cases such as wireless key systems and transport tickets (basically RFID technology) are in widespread use without much problems and great value for users – but not present in the public discussion.

One interesting estimated was that about 200 parts of the several thousands (e.g. safety related parts, large parts, parts that are often stolen, expensive parts) per car will tagged with RFID in the next 10 years to ease logistics, production and maintenance.

[1] Schmidt, A.; Spiekermann, S.; Gershman, A.; Michahelles, F., “Real-World Challenges of Pervasive Computing“, Pervasive Computing, IEEE , vol.5, no.3pp. 91- 93, c3, July-Sept. 2006.

[2] Michahelles, F.; Thiesse, F.; Schmidt, A.; Williams, J. R.: Pervasive RFID and Near Field Communication Technology. In: IEEE Pervasive Computing, vol. 6, no. 3, pp. 94-96, c3, Jul., 2007.

[3] Hans-Werner Gellersen, Albrecht Schmidt, Michael Beigl: Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts. MONET 7(5): 341-351 (2002)

[4] Matthias Kranz, Albrecht Schmidt, Alexis Maldonado, Radu Bogdan Rusu, Michael Beetz, Benedikt Hörnler, Gerhard Rigoll: Context-aware kitchen utilities. Tangible and Embedded Interaction 2007: 213-214

[5] Anke Thede, Albrecht Schmidt, Christian Merz: Integration of Goods Delivery Supervision into E-commerce Supply Chain. WELCOM 2001: 206-218

Talk at the opening of the Fraunhofer IAO interaction lab

The Fraunhofer institute IAO opened today a new interaction lab in Stuttgart under the topic interaction with all senses. Prof. Spath, director of the Fraunhofer IAO, made a strong argument for new user interfaces. In his talk he discussed adaptive cruse control in cars as an example for user interface challenges.

My talk on “implicit interaction – smart living in smart environments” argues for a sensible mix of user centred design and technology driven innovation. As one example I used the Sensor-Knife which Matthias Kranz implemented.

Prof. Jürgen Ziegler, a colleague at the University of Duisburg-Essen who was previously at IAO, showed in his talk a short video of a “galvanic vestibular stimulation” GVS explored by NTT (SIGGRAPH 2005 Demo) to highlight trends and indicate at the same time ethical problems that can arise when we interfere with human senses.

Basics of Law – Talk by Herbert Burkert

Herbert Burkert gave a presentation at IAIS on the very basics of public law. He is professor of public law, information and communication law at the research center for information law at the University of St. Gallen, Switzerland. He is currently on leave from Fraunhofer IAIS.

For developers and researchers in computer science that build real systems which can be deployed it is a great challenge to ensure compatibility with the law. In particular systems that are accessible over the world wide web in almost any country it appears really difficult to conform to all laws in the countries where potential users are.

With our current summer project where we built a search engine for people the legal conditions are besides the technological challenges a main concern.

It is clear that there is a distinction between morally right (or common sense right) and legally right – that is why many TV-pseudo-quiz programs are on and legal even though it is clear that common sense would see them as fraud. With new technologies there appears to be often a gap between on one side what is illegal and on the other side what is wrong but legal. The second one seems to be a domain where people make money…

Will caching and Redundancy be key?

Skype is down for a few hours and is has an impact on users. It is interesting that for some people I do not have regular phone numbers anymore. This minor (at least to me) inconvenience and the massive reaction in the news shows however how much we start to rely on network centred infrastructure tools.

Thinking about myself: xing and linked have largly replaced my local contacts database and my calendar is online, too; the acm-digital library, springer link, computer.org and google-scholar make me through away papers after I have read them (at the beginning of my PhD-studies I still sorted them in folders); gmail and gmx hold my private mail in the network; I have not bought paper maps for quite some time, and as recently posted access to knowledge is nowadays often via google. The current move of putting applications online – which I really like greatly – speeds up these trends.

With current sizes of hard drive and future network connectivity I think caching and recording becomes key. For many domains this is easy. Everything you have ever seen on the screen will be forever on the computer (easy for static content such as web pages, even for videos this is not far in the future; assuming 365 days x 8 hours x 1Gbyte/hour is about 3TByte/year). In many domains Pre-fetching seems useful. In some areas this seems straightforward. When you view a paper all papers that are cited and papers that cite this paper will be cached locally (and not just short term, but forever ;-), too.

I wonder when we can by the entire index of the web (e.g. google cache) for offline use. Will this every be possible or is content growing faster than storage?

At least I will start caching important information (e.g. mail & contacts) in the future locally.

From a business perspective this is interesting, too. Even if there is a major provider (e.g. Skype) people will create their own redundancies with a further provider (e.g. messenger) – so there will be always room for several players.

What is the Digital Equivalent of a Park in a City?

The visit to the eCulture Factory showed me again that bringing new media into the real public space creates new and very valuable insights, even though it is difficult and costly. Such installations can give a glimpse of what future public space will be. When thinking of the design space for media in public spaces one can image to create completely different and new experiences. Contextuality and awareness seem key design criteria.

Transforming public space using digital technology offers a lot of chances. However it seems that currently a lot of people think about this mainly with regard to new forms of advertising (obviously us included). But after seeing the installations in Bremen I think there is a great chance to improve the quality of life in a place with digital technologies. We probably should think more along the non-short-term-business-lines in this domain.

Thinking of quality of life… who wants to live in a city without a park or at least some green patches? No one – really. Perhaps it is time to invent the digital equivalent of a park for public spaces of the future. I think I have to do some reading to understand the traditional motivation behind parks…

Visiting the pervasive computing labs @ Johannes Kepler University in Linz


It is always great to visit the pervasive computing labs in Linz – always new and cool research to see. Looking at my my Google News-Alert it seems that the term “pervasive” is dominate by Alois 🙂

Alois Ferscha showed me their interaction cube. It is a really interesting piece of research and the background and argument of the cinematic of the hand shows a deep insight. There are some slides on the Telekom Austria Cube that are worthwhile to look at. It is interesting that he has gone successfully the full cycle from concept to product (image is taken from the slide show).

We talked about location systems and what options are available on the market. In Linz they have one room where they have high accuracy tracking based on an array of InterSense systems. Our experience in Bonn with the ubisense system has been mixed so far. Perhaps there are different technologies to come (or we have to develop them).

New German book “on everyday computing” available

In 2005 Friedeman Mattern organized a symposium at ETH Zurich on how computing impacts everyday life (http://www.comp21.inf.ethz.ch/). He edited a book (Die Informatisierung des Alltags. Leben in smarten Umgebungen, @Amazon) which includes versions of most of the talks. The book is in German.

I contributed a chapter to the book (draft version) on the symbioses between humans and computers. In the paper the idea of novel user interfaces that augment human capabilities and improve our ability in what we can do with technology is assessed. It is mainly based on the work done in the DFG funded project Embedded Interaction.

If you can read German I highly recommend the book. It is an interesting collections on viewpoints of pervasive computing. There is also a great chapter (the last in the book) by Friedeman Mattern himself discussing old a new visions of technologies.

acatech workshop: object in context

It was interesting to see that smart objects / smart object services, context, NFC, and RFID become very mainstream. It seems that nearly everyone buys into these ideas now.

Dr. Mohsen Darianian (from Nokia Research, same building as Paul Holleis is at the moment) showed an NFC-advert video which reminded me on the results of an exercise we did on concept videos within an HCI-class at the University of Munich 🙂

Overall it seems that acceptance and business models are of great interest and that to create them a lot of technical insight is required. The issues related to user interfaces, interaction, experience become central factors for the success of products and services.

One discussion was on the motivation for people to contribute (e.g. user generated content, write open source code, answer questions in forums, blogs). Understanding this seem crucial to the prediction whether or not a application is going to fly or not.

Besides contributing for a certain currency (e.g. fame, status, money, access to information) it seems that altruism may be an interesting factor for motivating potential users. Even if it is a low percentage within our species the absolute number on a world wide scale could be still enough to drive a certain application/service. There is interesting research on altruism in the animal world (or at the researchers page http://email.eva.mpg.de/~warneken/ ) maybe we should look more into this and re-think some basic assumptions on business models?

Our break out group was in the rooms of the Institute of Electronic Business e.V (http://www.ieb.net/). It is a very pleasant environment and their link to the art school reflects very positive on the atmosphere and projects. The hand drawn semacodes were really impressive.

Panel on Users as Producers at Schloss Birlinghoven

In the castle on campus Ute Schütz and Michael Krapp from IAIS and SCAI organize a public panel discussion on citizen journalism and Web 2.0 trends. The discussion looked at the topic from several angles including technology, content, and communication. I had the honour to be on the panel with Wolfgang Back, Frank Patalong, Moritz „mo.“ Sauer and Thomas Tikwinski.

On issue was how much blogs are (mis)used to transport information or to do advertising. The web seems to be to many people a very believable medium. This reminded me of an article I read some time ago on story-telling o n the web (Miller, J. 2005. Storytelling evolves on the web: case study: EXOCOG and the future of storytelling. interactions 12, 1 (Jan. 2005), 30-47. DOI= http://doi.acm.org/10.1145/1041280.1041281). I think something along this lines would an interesting project with students.

The questions what is going to change in the near future on the WWW brought many trend statements out, but for me it is amazing that most of the infrastructure and technology we need to make this happen is out there. One comment which I think is really true is that it is more an more about content and communication again. As Thomas said before the panel – most of the great things that are called Web 2.0 have been in the original proposal for the WWW (e.g. annotations by everyone or users as editors) – but now technology is finally there that people can use it.

Panel on Sensor Networks – Applications are the Key

Debora Estrin made an interesting statement. The “early challenges” (the thousands or millions of randomly scattered sensor notes) do not have much applicability outside the battlefield. The new challenges are heterogeneity (specific sensors with specific capabilities) and interactivity (basically sense-making is a process where humans are involved). She made the point that the logical consequence is that dealing with data is the essential issue and statistics have an increasing role. Furthermore these new research directions make a stromg call for application driven research. With these very insightful comments she criticised a lot of the current work in sensor networks. Especially the observation that there is no such thing as a “general sensor” – it points out that concrete applications are required to make meaningful contributions, even to basic research in sensor networks research.

PerTec Workshop in NY, Ripping off the Antenna

At PerCom 2007 (www.percom.org) Florian Michahelles (Auto-ID labs, ETH Zurich), Frédéric Thiesse (University of St. Gallen), John R. Williams (MIT Cambridge) and I are running the the PerTec workshop (www.autoidlabs.org/events/pertec2007). There is quite some interest in the topic and the range of topics is from technical to user interface and security.

In contrast to the workshop 1 year ago at Pervasive 2006 it seems that item level RFID-tagging is undisputed and that the only discussion point is when it is coming – in 6 month or 10 years. There is also still some discussion about what types of products are the first ones that are tagged – is it pharmaceuticals or cloth?

There was an interesting contribution by Paul Moskowitz from IBM, the clipped tag. It is a tag where you can physically rip off some part the antenna to reduce the read range from several meters to centimetres (see the pictures). It is really interesting that people can do a very clear and visible action to change the characteristics of a tag. The only questions that remains for me – will people trust that this really rips of the antenna? Probably yes…

The topics we discussed included security, privacy, location and RFID, end user issues, and connection of sensors to RFID, we hope to write it up in an overview article.

In the break out groups one discussion centered on the question what would we need to enable end-users to create novel applications using RFID? Further results of the discussion will be available on the workshop webpage soon.

The overall theme that emerged again and again is impact of real world constraints in RFID systems. Questions like: Can you achieve anonymity with a certain protocol? Can not be answered without knowing how it is used in the real world. Especially having recently learned a lot about data-mining (being at Fraunhofer IAIS) for me the questions of exploiting data collected in RFID systems looks really challenging.

Broadcasting your Heart Beat



This morning the first 3 students completed the exercise part of our lab class. For the first team the basics are done and we start with the exciting part 😉

We have different sensors that can be connected via Bluetooth to the phone (e.g. heart rate, pulse oximeter, GPS) and the task for the project is to invent a new application that makes use of sensors and creates a new user experience.

In the brainstorming session some were tearing out their hair – but it was rewarding. Some of the ideas that came out are really novel – and perhaps a bit to crazy to implement them. One example of such an idea is to create a web radio station that broadcasts the live heart beat of celebrities as an audio stream (not sure if this is the right way to fame). Other ideas centered on support for sport, exercise and mobile health.

Alexander De Luca (a former colleague from LMU Munich) was spending the last few days with us here. He helped greatly to write some code to get the Alivetec-ECG data parsed.

Affectionate Computing

Thecla Schiphorst introduced us in her talk “PillowTalk: Can We Afford Intimacy? to the concept of Affectionate-Computing.
The central question is really how can we create intimacy in communication an interaction with and through technology? The prototype showed networked soft objects, that include sensors that recognize tactile qualities and gesture interaction. There are more details in her paper published at TEI’07.