A tale of challenge for mouse and keyboard

Microsoft's motion-control sensor Kinect looks like revolutionising computing with its wide applicability, and traditional means of input and control may be at risk.

Microsoft's Kinect last year became the fastest-selling consumer electronics device, outstripping even the Apple iPhone. David Becker / Getty Images / AFP

The computer industry is hailing a new technology it believes will transform consumer and business electronics. The keyboard and computer mouse may soon be replaced by hand gestures and body movements monitored by highly sensitive motion detectors.
Microsoft has this month launched a version of the voice-and-motion control sensor Kinect for PCs. Kinect began life as an add-on for the XBox 360 game console. According to Guinness World Records, Microsoft's original gesture-based screen control system last year became the fastest-selling consumer electronics device, outstripping even the Apple iPhone - in the period immediately following each product's launch.
But where the Xbox 360 version of Kinect requires gamers to stand at least six feet away from its sensors before making hand and arm signals, the PC version's monitors track movements from as close as 16-19 inches and use enhanced features such as "skeletal recognition".
This enables not only motion-control PC gaming, but also allows commercial and educational applications. These include allowing surgeons to navigate body scans by waving their hands and allowing young children to control educational programmes by pointing at computer screens.
Tedesys, a Spanish company now specialising in developing applications for Kinect, has already tested the technology for use in the operating theatre at the Marqués de Valdecilla University Hospital in Santander in Spain. This enables surgeons to access MRI and CAT scans on a nearby screen with hand gestures, allowing operations to continue uninterrupted.
In the US, the University of Missouri is using Kinect to measure and monitor subtle changes in the movements and gait of the elderly. Constant monitoring of elderly patients' movements will enable physicians to intervene sooner if there is a problem, thereby preventing dangerous and possibly lethal falls and other accidents.
Another early commercial application of Kinect was seen at the North American International Auto Show in Detroit last month, where it was used to offer visitors a virtual tour inside a new Nissan vehicle. Razorfish, a marketing agency that started in Seattle, is reported to be using Kinect to allow shoppers to project their images onto a screen, allowing virtual handling of potential purchases.
According to Microsoft spokesman Aman Sangar: "It's been just over a year since Kinect for Xbox 360 was launched, but since then we have received a huge influx of interest from developers looking for alternative applications to harness its technology across industries . Today, we have over 250 customers building natural user interface (NUI) applications to reshape how they do business."
Industry watchers believe that Kinect is now ushering in an entirely new age of personal computing. James McQuivey, an analyst at the research company Forrester, says the technology represents a moment of massive change similar to the launch of TV. He calls the new age of motion sensor computing "The Age of Experience".
According to Adrian Drury, a principal analyst at the research company Ovum: "Kinect is a showcase example of how powerful technology that has been engineered and produced for the scale available in consumer markets will find applications in enterprise markets."
He adds that while effective motion detection systems once cost about US$50,000 (Dh183,660) each, Kinect makes similar technology cheaply and widely available for a variety of commercial sectors.
Tim Shepherd, a senior analyst at research company Canalys, says: "Offering control of computing programs through gestures and movements can, if well designed, be highly intuitive with potential accessibility benefits for young children, elderly users, or the computer illiterate."
He adds: "In addition to gaming, user interface navigation on PCs, televisions, kiosks and interactive displays, exhibits or educational programs, can benefit from more natural gesture input."
However, Microsoft is unlikely to have the motion-sensor market all to itself. Nintendo's Wii games console originally trailblazed the consumer motion-sensor market with gesture recognition.
Apple is also pioneering NUI technologies. In Apple's case, its interface, Siri, acquired by Apple almost two years ago, is voice reactive rather than being controlled by physical gestures.
"It is also something being worked on by companies such as Qualcomm and Intel, that are using ultrasound and camera technologies, respectively, to bring gesture control interfaces to mobile devices and applications, as well as smaller players such as EyeSight and GestureTek," adds Mr Shepherd.
But despite reports that Kinect motion sensors may soon be incorporated into some high-end laptops running Microsoft's new Windows 8 operating system, motion-control is still some way from becoming a standard feature on PCs.
According to Mr Drury, in the short to medium term, gesture-led applications will be limited to specific job roles and industries, rather than immediately having an impact on mainstream devices.
"The keyboard, mouse, touchscreen, and alphanumeric keypad are not at immediate risk, although gesture and voice-based controls such as Apple's Siri are certainly creating opportunities to question accepted interface methods," says Mr Drury.
But companies such as Microsoft are betting heavily that the days of the mouse and keyboard are numbered for many users. Microsoft alone has already invested hundreds of millions of dollars and years of research in motion control technology.
[e-mail]
twitter: Follow our breaking business news and retweet to your followers. Follow us