In the often referenced Minority Report, Tom Cruise flips though crime files comprised of complex data sets and videos in a fully gesture supported immersive computing experience. This is duplicated in Marvel’s Iron Man movies with Tony Stark flipping through 3-D models with mere gestures and voice control.
A more real-time example of the power of gesture-based interfaces could be found first in the explosive use of the Wii, and today the burgeoning popularity of the Kinect interface for the X-Box. So why now the focus on gestures as a methodology of interacting with everything from smart phones, tablets, video games, and all manners of industrial computing?
As the computing environments become more complex, interaction mediums are becoming more difficult to translate into keystrokes or button push combinations; gestures can bridge this gap. Just think about the countless videos of babies on the Internet interacting with iPads and iPhones before they can even talk, showing the simplicity and universal understanding of gestures as an interaction medium. However, while gestures are very easy to consume as a part of the application interface, they are extremely difficult to integrate into applications. As the device screen and size of the interaction space evolves, gestures will need to transform. Apple demonstrated this successfully by adding three-finger and four-finger swipe gestures into their operating system.
This all points to specified requirements for:
- Screen sizes
- Operating systems
If you are in your early days of mobile application exploration, or just beginning to build out mobile apps for your customers and employees, look towards gestures to provide more immersive interfaces. Start out slowly and understand how the differences manifest themselves across different devices, device classes, and operating systems. Find applications that utilize gestures well and dig deep on those interfaces. Finally, as gestures move outside of touchscreens, look to optimize the learning from those touch screens in additional computing paradigms.