Thursday, October 15, 2009
10/GUI: Multi-touch Interface and Interaction
Take a look at this video and the discussion about it - food for thought!
10/GUI: Another Twist to Multitouch Interface and Interaction
Monday, January 19, 2009
Touch Screen Interaction in Public Spaces: Room for Improvement if "Every Surface is to be a Computer"!
With Win7's "multi-touch" capabilities, Bill Gate's statement that every surface will be a computer might come true, but from what I can see, we have a long way to go before we get it right!
One of the concerns I have about "touch" screen interaction in public spaces is that not much thought is given to the environmental factors surrounding the system. The system that is tested for the first time after installation might work just fine, but not when it is put to use under a variety of conditions or situations.
EXAMPLES (I've recycled a few of these from previous posts.)
Below is a shot of my husband, trying to see what is on the screen. This photo shows exactly what the screen looked like at the time:
The next picture tells it all. You can see that there is some sort of alphabet on the right side of the screen, but the reflection of my husband is easier to see. We couldn't figure this one out.
The following clip demonstrates how environmental concerns, such as wind and "sideways" rain, can make an interactive display at a shopping center difficult to use. During this clip, you can hear me muttering about the difficulties I had interacting with the information on the touch-screen display. It is possible that the system wasn't working well because of the exposure to the elements.
In my opinion, an interactive wayfinding application should run on a larger display and support two or more people, since many hospital visitors often run in pairs or small groups.
Saturday, August 16, 2008
Microsoft Surface's Hotel Concierge Application: Let's see this deployed in classrooms, museums, libraries, welcome centers, convention halls..
Take a look at the following video to see how Microsoft Surface's Hotel Concierge application plays out at a Sheraton hotel:
Of course, surface-like applications would have to become much more affordable in order to become ubiquitous in our schools, libraries, airports, and other public spaces.
(Cross-posted on the Interactive Multimedia Technology blog.)
Friday, May 23, 2008
Multitouch LaserTouch from Microsoft, Andy Wilson, Innovation..
I've been a Mac person since 1985, but I've warmed up to Microsoft a bit over the years. Microsoft Research is involved in many creative endeavors, despite how the company is personified by "PC" in Apple's MAC/PC commercials.
Ever since I had a chance to get my hands on an interactive whiteboard, I've been fascinated by large multi-touch and multi-user displays, and this fascination was part of my motivation to take graduate-level computer/IT classes at mid-life!
After spending an entire semester working on large touch-screen projects last year, Microsoft unveiled the Surface, which is not within my reach. Now that Bill Gate's mantra is "every surface to be a computer", there might be hope for people like me.
Via CNET news 8/14/08: "During his keynote Wednesday at the CEO Summit, Microsoft Chairman Bill Gates shows off TouchWall, a 4-foot-by-6-foot touch-screen computer prototype."(Credit: Microsoft)
Microsoft Research's Andy Wilson developed the software for the LaserTouch prototype. Andy is a member of the Adaptive Systems and Interaction group.
The system will be less expensive than the Surface, but it is not yet ready for the masses:
Via CNET: "Andy Wilson, a researcher from Microsoft Research's Redmond, Wash., campus, demonstrates LaserTouch. An infrared camera tracks how he touches the screen to prompt a response from the software." (Credit: Stefanie Olsen/CNET News.com)
Related:
InfoWorld Article about TouchWall CNET TouchWall Article
InfoWorld Article about LaserTouch CNET LaserTouch Article
Natural User Interface - Innovative Multi-touch Solutions
NextWindow NextWindow Videoclips
Shahram Izadi's Research Website
TouchLight: An Imaging Touch Screen for Gesture-Based Interaction pdf
Interacting with Wall-Sized Screens pdf
The Large-Display User Experience pdf
IEEE Tabletops and Interactive Surfaces 2008 Conference Website
October 1-3, the Netherlands
Note: For those of you new to this blog, I've posted quite a bit about multi-touch displays, Microsoft's Surface table, urban screens and interfaces over the past year or so on the TSHWI and Interactive Multimedia Technology blogs. Also see the links on this blog's sidebars.
Sunday, May 11, 2008
Urban Screens, Urban Interfaces, Digital Media, and the Arts in Social-Public Spaces
Technology-supported human-world interaction is the phrase I created to help me handle things conceptually, and serves as an umbrella that covers the things that interest me within this sphere.
I recently participated in the Games for Health Conference. Eric Walker, from Ominous Development, in his talk about the development of a one-switch game, discussed the idea that when we think about games, there are three main areas of focus. One is the how the game is played within the machine, system, or computer. One is how the game is played within the interface, and one is how the game is played in the mind.
If you think about multi-player games, a fourth dimension is added- the social context. Take this one step further, in the realm of pervasive gaming, including mixed/augmented reality games, a fifth dimension must also be considered, which includes space, place, and geo-location. How does that play out in the world? I'd like to share a bit of what I've come across so far:
08 Urban Screens: The potential of screens for urban society
- "URBAN SCREENS investigates how the currently commercial use of outdoor screens can be broadened with cultural content. We address cultural fields as digital media culture, urbanism, architecture and art. We want to network and sensitise all engaged parties for the possibilities of using the digital infrastructure for contributing to a lively urban society, binding the screens more to the communal context of the space and therefore creating local identity and engagement. The integration of the current information technologies support the development of a new integrated digital layer of the city in a complex merge of material and immaterial space that redefine the function of this growing infrastructure."
- "URBAN SCREENS defined as various kinds of dynamic digital displays and interfaces in urban space such as LED signs, plasma screens, projection boards, information terminals but also intelligent architectural surfaces being used in consideration of a well ballanced, sustainable urban society - Screens that support the idea of public space as space for creation and exchange of culture, strengthening a local economy and the formation of public sphere. Its digital nature makes these screening platforms an experimental visualisation zone on the threshold of virtual and urban public space." (Mirjam Struppek)
One company, Soda , is involved with emerging technologies that are used in public spaces: "Soda develops creative tools that help communities work, play, and learn together" .
The Soda team members come from both art and technical backgrounds. One of Soda's projects was "Energy", which was an external light installation at a school, consisting of 45 LED panels, distributed on a large structure, in view of the playground. The designs on each panel were created by students, and the software behind the displays incorporates video shot by the children, so the art can be easily changed.
Soda partnered with FutureLab to create Newtoon, a suite of web-enabled microgames and activities, designed to promote the learning of physics social way, played on mobile devices.
Case study of the Newtoon prototype
Urban Interfaces is a project of the Australasian CRC for Interaction Design, and builds upon the work of their previous Suburban Communities project.
- "Urban Interfaces: designs, develops and evaluates “unconventional” interfaces, such as interactive urban/public screens, and mobile and embedded content, to improve social, economic and environmental sustainability, researching appropriation (adoption and adaptation) and embodied interaction (in the moment and in the world) in master-planned and existing residential communities."
People from the Urban Interfaces project recently presented a public displays workshop at CHI 08: Designing and Evaluating Mobile Phone-Based Interactions with Public Displays . According to the workshop paper, the " program is developing Future Ethnography to combine social context approaches, particularly ethnography, with participatory design, and applying it to mobile-, embedded-, and WWW-based experiences."
The people involved in this project include Ian MacColl and Margot Brereton, from ACID/QUT, Matthew D'Souza, Andrew Dekker, Adam Postula, Fiona Redhead, from the University of Queensland, Mark Billinghurst, from HACID/HITlabNZ, Ingrid Richardson, from ACID/Murdoch University, and Montse Ros, from ACID/University of Wollongong.
Update:
I recently received a comment from Ori Inbar with a link to http://www.gamesalfresco.com/, which has a good review of the "top ten" devices for mobile augmented reality, also known as AR.
Another interesting post from Games Alfresco reviews "top ten" augmented reality demos that have the potential to change augmented reality gaming. Comogard, the author of this post, writes that AR "has the potential to do something that parents can't: free gamers from their couches and usher them into the real world, to play".
In my opinion, AR games, played on mobile devices that support new games for health and learning. With the influx of large interactive displays (or interactive whiteboards) in public gathering spaces, libraries, museums, and schools, there is a possibility that mobile AR can be played out on a variety of screens, large and small.
Some of the thought behind Microsoft's Surface came from the work of Shahram Izadi, now at Microsoft Research, Harry Brignull, now a user experience consultant at Madgex, and Yvonne Rogers, a professor of human-computer interaction at Open University, and others, on the Dynamo project.
(See my previous post- Revisiting Promising Projects: Dynamo- an application for sharing information on large interactive displays in public spaces.)
For detailed information about the Dynomo project, read The Iterative Design and Study of a Large Display for Shared and Sociable Spaces (pdf).Harry Brignull's blog post, "Microsoft Surface: standing on the shoulders of giants" , written on the day the Surface was unveiled to the public last year, also provides good background information related to this topic.
Back to the Urban Screens discussion:
First Monday, a peer-reviewed journal on the Internet, published a special issue, Urban Screens: Discovering the Potential of Outdoor Screens for Urban Society, in 2006. The articles were written by people from disciplines related to media and communications, so they provide a much broader perspective to the topic of large screen displays than found in journals published by the ACM or IEEE. (If you are a CS or IT academician involved in large display and/or ubiquitous computing research, this series is a must-read!)
Raina Kumra, in Hijacking the Urban Screen, discusses the use of non-traditional outdoor advertising, and looks at way this new "media skin" is responding to interaction, transforming the more traditional video billboard to something that is creative and invites public participation.
In Urban Screens: the beginning of a universal visual culture, Paul Marten Lester points to Otto Neurath's quote, "words divide, pictures unite". According to Lester, "Literal, narrative, horizontal, cloistered, and verbal culture is being replaced by symbolic, interactive, profound, global, and visual culture. Neurath would be pleased." Lester delves into the world of visual symbols, visual thinking, and visual communication. His reference list, for the academics out there, is full of gems!
Scott McQuire's article, The politics of public space in the media city, discusses the concept of hybrid spaces, or media cities, and his thoughts about access and interaction, and a "democratic public culture in cities connected by digital networks."
In The poetics of urban media surfaces, Lev Manovich discusses how technologies such as video surveillance, data-filled "cell-space", and electronic displays transform physical spaces into data-spaces (think "Internet of Things"). Included in his discussion is an outline of some of technological research related in some way to urban media surfaces: ubiquitous computing, augmented reality, tangible interfaces, wearable computers, intelligenct buildings, intelligent spaces, context-aware computing, ambient intelligence, smart objects, wireless location services, sensor networks, and e-paper.
I haven't finished reading all of the articles included in First Monday's special issue about urban screens. Listed below are the references and links for all of the articles, with links to many of the authors:
Hijacking the urban screen: Trends in outdoor advertising and predictions for the use of video art and urban screens by Raina Kumra First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/kumra/index.html
Urban Screens: the beginning of a universal visual culture by Paul Martin Lester First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/lester/index.html
The politics of public space in the media city by Scott McQuire First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/mcquire/index.html
The poetics of urban media surfaces by Lev Manovich First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/manovich/index.html
Interpreting urban screens by Anthony Auerbach First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/auerbach/index.html
Story space: A theoretical grounding for the new urban annotation by Rekha Murthy First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/murthy/index.html
The urban incubator: (De)constructive (re)presentation of heterotopian spatiality and virtual image(ries) by Wael Salah Fahmi First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/fahmi/index.html
Urban screens: Towards the convergence of architecture and audiovisual media by Tore Slaatta First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/slaatta/index.html
Towards an integrated architectural media space by Ava Fatah gen. SchieckFirst Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/fatah/index.html
Art and social displays in the branding of the city: Token screens or opportunities for difference? by Julia Nevárez First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/nevarez/index.html
For an aesthetics of transmission by Giselle Beiguelman First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/beiguelman/index.html
Intelligent skin: Real virtual by Vera Bühlmann First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/buhlmann/index.html
Programming video art for urban screens in public space by Kate Taylor First Monday, Special Issue #4: Urban Screens: Discovering the potential of outdoor screens for urban society (February 2006),URL: http://firstmonday.org/issues/special11_2/taylor/index.html
Mirjam Struppek at Interaction Field: "Urban Space, Public Sphere, and the New Media"
