Thursday, December 31, 2009

Josh Blake's Nice Multi-touch and Natural User Interface Applications for Surface and Windows 7

Information from Josh's YouTube channel:
"This is a video of some of the cool multi-touch and Natural User Interface (NUI) applications I designed and developed for Surface and Windows 7." The InfoStrat.VE map control for WPF and Surface is available for free at

I especially like the moving ring-menu concept, as it facilitates smoother collaboration between people on an interactive table or surface, where flexible orientation control is important.

At 3:15, the demonstration of Josh's ink-shape recognition begins. This is a feature that would be great to incorporate in my applications for children with disabilities who have some fine-motor limitations.

Josh's Blog:  Deconstructing the NUI
Josh's Recent Post about post-WIMP concepts:
Metaphors and OCGM
Josh works at InfoStrat


JoshB said...

Thanks for posting this Lynn!

The ink shape recognition is still a work in progress. I will think about how people might be able to integrate it with their applications.

There are definitely applications for education and children. I mentioned this on the nuigroup forum but I'll copy it here as well:

The inspiration for working on the shape recognition in this way is actually the 2019 Productivity Future Vision video, the first minute where the children are drawing things (like a dog, a ball) and the actual thing they draw comes to life. Since I identify the corner, curve, line components of the shape drawn, the shape could potentially be animated dynamically using abstracted behaviors of the recognized shape. Draw a short dog, it will like a short dog. Draw a large dog, it will act like a large dog.

Lynn V. Marentette said...

I was inspired by that part of the video, too!