Introduction to the special issue on interaction beyond the desktop

After coming back from CHI2012 in Austin I found my paper copy of the April 2012 issue of IEEE Computer magazine in my letter box. This is our special issue on interaction beyond the desktop. Having the physical copy is always nice (it is because I probably grew up with paper magazines ;-).

This guest editors’ introduction [1] is an experiment as we include photos from all papers on the theme. The rational is, that probably most people will not have the paper copy in their hand. When having the digital version the overview of the papers is harder to manage, that is why we think including the photos helps to make readers curious to look at the papers in the issue. Please let us know if you think this is a good idea…

[1] Albrecht Schmidt and Elizabeth Churchill. Interaction Beyond the Keyboard. IEEE Computer, April 2012, pp. 21–24. (PDF). Link to the article in Computing Now.

>Introduction to the special issue on interaction beyond the desktop

>After coming back from CHI2012 in Austin I found my paper copy of the April 2012 issue of IEEE Computer magazine in my letter box. This is our special issue on interaction beyond the desktop. Having the physical copy is always nice (it is because I probably grew up with paper magazines ;-).

This guest editors’ introduction [1] is an experiment as we include photos from all papers on the theme. The rational is, that probably most people will not have the paper copy in their hand. When having the digital version the overview of the papers is harder to manage, that is why we think including the photos helps to make readers curious to look at the papers in the issue. Please let us know if you think this is a good idea…

[1] Albrecht Schmidt and Elizabeth Churchill. Interaction Beyond the Keyboard. IEEE Computer, April 2012, pp. 21–24. (PDF). Link to the article in Computing Now.

Introduction to the special issue on interaction beyond the desktop

After coming back from CHI2012 in Austin I found my paper copy of the April 2012 issue of IEEE Computer magazine in my letter box. This is our special issue on interaction beyond the desktop. Having the physical copy is always nice (it is because I probably grew up with paper magazines ;-).

This guest editors’ introduction [1] is an experiment as we include photos from all papers on the theme. The rational is, that probably most people will not have the paper copy in their hand. When having the digital version the overview of the papers is harder to manage, that is why we think including the photos helps to make readers curious to look at the papers in the issue. Please let us know if you think this is a good idea…

[1] Albrecht Schmidt and Elizabeth Churchill. Interaction Beyond the Keyboard. IEEE Computer, April 2012, pp. 21–24. (PDF). Link to the article in Computing Now.

>cfp: IEEE Special Issue on Interaction Beyond the Keyboard

>IEEE Computer will have a special issue on “Interaction beyond the Keyboard” … and till Nov 1st 2011 you still have a chance to submit :-)

— from the call (http://www.computer.org/portal/web/computingnow/cocfp4) —
Final submissions due: 1 November 2011
Publication date: April 2012

IEEE Computer seeks submissions for an April 2012 special issue on interaction beyond the keyboard.

Interaction with computers has become an integral part of daily life for most people. When making a phone call, listening to music, taking a photo, getting money from an ATM, or driving a car, we operate computer systems with complex functionalities. As technologies progress, the proliferation of computing technologies increases, and simple user interfaces and ease of use are becoming key success factors for a wide range of products.

Although the keyboard and mouse are still the dominant user interfaces in home and office environments, with the massive increase in mobile device usage and the many new interaction technologies available, the way we interact with computers is becoming richer and more diverse. Touch-enabled surfaces, natural gestures, implicit interaction, and tangible user interfaces mark some of these trends.

The overall goal of interaction beyond the keyboard is to create natural and intuitive forms of human-computer interaction that make it easier for people to achieve their goals while using computers as tools.

For this special issue, we seek original research that describes groundbreaking new devices, methods, and approaches to human-computer interaction in a world of ubiquitous computer use. In particular, we’re looking for exciting work that is concerned with the following topics:

  • interactive surfaces and tabletop computing;
  • mobile computing user interfaces and interaction while on the go;
  • tangible interaction and graspable user interfaces;
  • embedded user interfaces and embodied interaction;
  • natural interaction and gestures; and
  • user interfaces based on physiological sensors and actuators.

Articles should be understandable to a broad audience of computing science and engineering professionals. The writing should be practical and original, avoiding a focus on theory, mathematics, jargon, and abstract concepts. All manuscripts are subject to peer-review on both technical merit and relevance to Computer’s readership. Accepted papers will be professionally edited for content and style.

—–

please see: http://www.computer.org/portal/web/computingnow/cocfp4

cfp: IEEE Special Issue on Interaction Beyond the Keyboard

IEEE Computer will have a special issue on “Interaction beyond the Keyboard” … and till Nov 1st 2011 you still have a chance to submit :-)

— from the call (http://www.computer.org/portal/web/computingnow/cocfp4) —
Final submissions due: 1 November 2011
Publication date: April 2012

IEEE Computer seeks submissions for an April 2012 special issue on interaction beyond the keyboard.

Interaction with computers has become an integral part of daily life for most people. When making a phone call, listening to music, taking a photo, getting money from an ATM, or driving a car, we operate computer systems with complex functionalities. As technologies progress, the proliferation of computing technologies increases, and simple user interfaces and ease of use are becoming key success factors for a wide range of products.

Although the keyboard and mouse are still the dominant user interfaces in home and office environments, with the massive increase in mobile device usage and the many new interaction technologies available, the way we interact with computers is becoming richer and more diverse. Touch-enabled surfaces, natural gestures, implicit interaction, and tangible user interfaces mark some of these trends.

The overall goal of interaction beyond the keyboard is to create natural and intuitive forms of human-computer interaction that make it easier for people to achieve their goals while using computers as tools.

For this special issue, we seek original research that describes groundbreaking new devices, methods, and approaches to human-computer interaction in a world of ubiquitous computer use. In particular, we’re looking for exciting work that is concerned with the following topics:

  • interactive surfaces and tabletop computing;
  • mobile computing user interfaces and interaction while on the go;
  • tangible interaction and graspable user interfaces;
  • embedded user interfaces and embodied interaction;
  • natural interaction and gestures; and
  • user interfaces based on physiological sensors and actuators.

Articles should be understandable to a broad audience of computing science and engineering professionals. The writing should be practical and original, avoiding a focus on theory, mathematics, jargon, and abstract concepts. All manuscripts are subject to peer-review on both technical merit and relevance to Computer’s readership. Accepted papers will be professionally edited for content and style.

—–

please see: http://www.computer.org/portal/web/computingnow/cocfp4

cfp: IEEE Special Issue on Interaction Beyond the Keyboard

IEEE Computer will have a special issue on “Interaction beyond the Keyboard” … and till Nov 1st 2011 you still have a chance to submit :-)

— from the call (http://www.computer.org/portal/web/computingnow/cocfp4) —
Final submissions due: 1 November 2011
Publication date: April 2012

IEEE Computer seeks submissions for an April 2012 special issue on interaction beyond the keyboard.

Interaction with computers has become an integral part of daily life for most people. When making a phone call, listening to music, taking a photo, getting money from an ATM, or driving a car, we operate computer systems with complex functionalities. As technologies progress, the proliferation of computing technologies increases, and simple user interfaces and ease of use are becoming key success factors for a wide range of products.

Although the keyboard and mouse are still the dominant user interfaces in home and office environments, with the massive increase in mobile device usage and the many new interaction technologies available, the way we interact with computers is becoming richer and more diverse. Touch-enabled surfaces, natural gestures, implicit interaction, and tangible user interfaces mark some of these trends.

The overall goal of interaction beyond the keyboard is to create natural and intuitive forms of human-computer interaction that make it easier for people to achieve their goals while using computers as tools.

For this special issue, we seek original research that describes groundbreaking new devices, methods, and approaches to human-computer interaction in a world of ubiquitous computer use. In particular, we’re looking for exciting work that is concerned with the following topics:

  • interactive surfaces and tabletop computing;
  • mobile computing user interfaces and interaction while on the go;
  • tangible interaction and graspable user interfaces;
  • embedded user interfaces and embodied interaction;
  • natural interaction and gestures; and
  • user interfaces based on physiological sensors and actuators.

Articles should be understandable to a broad audience of computing science and engineering professionals. The writing should be practical and original, avoiding a focus on theory, mathematics, jargon, and abstract concepts. All manuscripts are subject to peer-review on both technical merit and relevance to Computer’s readership. Accepted papers will be professionally edited for content and style.

—–

please see: http://www.computer.org/portal/web/computingnow/cocfp4

>Interesting touch technology: PhotoelasticTouch

>Hideki Koike talked at the Symposium on Interaction with Smart Artifacts in Tokyo. One of the examples he showed is the PhotoelasticTouch technology. The idea is to use a transparent gel and the effect of photoelasticity to detect interaction on a surface, see [1] for details. [2] give a brief overview (the picture below is taken from this publication).
There is a nice youtube videp the shows the concept very well: http://www.youtube.com/watch?v=RJaEg0xB98E

[1] Toshiki Sato, Haruko Mamiya, Hideki Koike, and Kentaro Fukuchi. 2009. PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST ’09). ACM, New York, NY, USA, 43-50. DOI=10.1145/1622176.1622185 http://doi.acm.org/10.1145/1622176.1622185

[2] One page abstract: http://www.vogue.is.uec.ac.jp/PET/photoelasticTouch1Page.pdf

Interesting touch technology: PhotoelasticTouch

Hideki Koike talked at the Symposium on Interaction with Smart Artifacts in Tokyo. One of the examples he showed is the PhotoelasticTouch technology. The idea is to use a transparent gel and the effect of photoelasticity to detect interaction on a surface, see [1] for details. [2] give a brief overview (the picture below is taken from this publication).
There is a nice youtube videp the shows the concept very well: http://www.youtube.com/watch?v=RJaEg0xB98E

[1] Toshiki Sato, Haruko Mamiya, Hideki Koike, and Kentaro Fukuchi. 2009. PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST ’09). ACM, New York, NY, USA, 43-50. DOI=10.1145/1622176.1622185 http://doi.acm.org/10.1145/1622176.1622185

[2] One page abstract: http://www.vogue.is.uec.ac.jp/PET/photoelasticTouch1Page.pdf

Interesting touch technology: PhotoelasticTouch

Hideki Koike talked at the Symposium on Interaction with Smart Artifacts in Tokyo. One of the examples he showed is the PhotoelasticTouch technology. The idea is to use a transparent gel and the effect of photoelasticity to detect interaction on a surface, see [1] for details. [2] give a brief overview (the picture below is taken from this publication).
There is a nice youtube videp the shows the concept very well: http://www.youtube.com/watch?v=RJaEg0xB98E

[1] Toshiki Sato, Haruko Mamiya, Hideki Koike, and Kentaro Fukuchi. 2009. PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST ’09). ACM, New York, NY, USA, 43-50. DOI=10.1145/1622176.1622185 http://doi.acm.org/10.1145/1622176.1622185

[2] One page abstract: http://www.vogue.is.uec.ac.jp/PET/photoelasticTouch1Page.pdf

TEI2011 Keynote: Bounce Back by Gilian Crampton Smith

Gilian Crampton Smith is one of the people that massively influenced the field of interaction design from the very beginning. She is currently working in Venice: www.interaction-venice.com. Nearly 20 years back in London Durrell Bishop was one of her students. She pointed out that the central insight of the early work was “We know how to control objects by physical means”. This insight has since become a basic motivation for tangible interfaces and embodied interaction. Closely linked to this is the complexity of interaction. To me one great point with designing tangible user interfaces is that you are forced to come up with a simple solution. Overall the argument was that embodied interaction works because it draws on knowledge we have. An example is that two physical things cannot be in exactly the same place and another one is that things stay where they are if there is no force moving them. There are clear limitations to the interaction with physical objects that give indications how to use it; she referenced a paper on an exploration of physical manipulation [1].

As one example Gilian showed the marble answering machine concept video from 1992. To me this video is a great example that shows the power of a concept video. Using a simple animation in this concept video enables viewers to understand the idea and interactions very quickly. I like the simplicity and clarity of this video – it would be very useful for teaching. Hopefully it will made publicly available; see below the bad-quality copy I took with my mobile. A good quality version ist at http://vimeo.com/19930744

One interesting point was a reflection on the shortcomings of the traditional view of interaction being based on input and output. Gilian argued that output should be separated in feedback and results. Input is categorized in according the interaction required, such as simple (e.g. text, minimal movement), medium (e.g. GUI), maximum (e.g. musical instrument, movement of the whole body). The feedback is related to the sense human have, and includes modalities such as visual, auditory, tangible, kinesthetic, proprioception. Results are related to feedback but are oriented on the outcome. Results may be visual (e.g. symbolic, words, icon, films); auditory (e.g. sounds, words or music) or physical such as touch (e.g. massage machine) or movement.

Gilian went on to the question: “Why aren’t tangible, embedded and embodied interfaces out there in our everyday world?” For me the most important answer she gave is that it is hard to do them. It is very difficult to created sensor based interaction in a way that users understand it and that it feels natural to use. Counter examples where people got it wrong are those many lights that go on when you are already half way up the stairs or the automatic doors where people wave their hands in order to open them. As much of the interaction technology in such systems is not visible people have a hard time figuring out how things work. Based on their (incomplete) experience base on a few interactions they will create their mental modal … which is often wrong and potentially leads to frustration. A further point she made is that creating physical interactive objects and things is difficult and involves a lot of different skills. In combination with the function it is difficult to get the aesthetics right. One very good example is how hard it is to the aesthetics of feel is right, as it includes a well balanced design taking into account touch, weight, balance, movement, and sound. Overall this requires a great passion for detail to get the quality of engineering right; Gilians examples for this was the AUDI advert where an Engineer opens and closes the car door and listens carefully. I think I have seen in 8 years back in the UK as part of the ad-campain “Vorsprung durch Technik”. If anyone has a link to a copy please post it.

When I was in 2002 (or around this time) visiting her at Ivrea near Torino I was very much impressed by the creativity and inventiveness. In her talk she explained one approach to teaching I really like. The students get a device (e.g. an alarm clock, answering machine) without manual with the task to figure out how it works. While exploring the functionality they film themselves. Based on this they reflect on the design and then go on to do a completely new design for a device with a similar functionality (with the constraint that it cannot have buttons).

I like a reference to something Bruce Steering wrote. In short it basically says research is like crime; you need Means, Motivation and Opportunity.

Some further example she showed:

  • A communication device based candle: ceramic liaison. It is a bi-directional 1-bit communication device, that is esthetically pleasing. The state of the candle (real wax with fire) on either side is reflected by lighting up some ceramics on the other side.
  • A full body experience interaction device for controlling games: Collawobble. Using two bouncing balls a packman game can be controlled. One user controls with the bouncing X and the other Y.

update:
Ellen Do posted 2 clips that were shown in the keynote

and suggested a further one: http://www.youtube.com/watch?v=oS6pwQqSY70

the marble answering machine video on http://vimeo.com/19930744

[1] Andrew Manches, Claire O’Malley, and Steve Benford. 2009. Physical manipulation: evaluating the potential for tangible designs. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI ’09). ACM, New York, NY, USA, 77-84. DOI=10.1145/1517664.1517688 http://doi.acm.org/10.1145/1517664.1517688