UI&us is about User Interface Design, User Experience design and the cognitive psychology behind design in general. It's written by Keith Lang, co-founder of Skitch; now a part of Evernote. His views and opinions are his own and do not represent in any way the views or opinions of any company.
There's a bunch of companies working with 3D cameras and gesture/anatomy analysis, including of course Microsoft's Natal. Control of TVs with this technology seems the first best fit.
I've been following Microsoft's Project Natal for a while now. Here's a video update — note the impressive 3D images coming in from the camera at 1:14.
Critisicsm on the web has been in the lines of "I don't want to wave my arms around to control my computer". And rightly so — I agree that this is a limited niche. However. Digital cameras, in a short decade or so have replaced analogue cameras due to their lowering cost, increasing pixel density and capture quality. In the same way, I envision this 3D technology quickly becoming cheap, high-quality and mainstream. Looking forward, this technology could be embedded into display screens itself. This would allow a touchscreen to obtain 'mouseover' information as well as improved touch information. It would also allow for more human gestures, performed over (but not touching) the flat input device, to activate occasionally needed actions.
For example:
Shake your hand like you're saying 'no thanks' over the device for Undo
Make a flat palm hand, like a sheet of paper, for New Document
It's this kind of device, which I can see replacing our mechanical keyboard and mouse.
To learn more, watch this 2006 Google tech talk explaining (what I believe is) similar technology. This is the first time I saw this technology, and their more long range version is impressive stuff. You need to scan forward about 20mins to get to the interesting stuff.
The video above shows some scenes which give you a sense of the 3D camera's data might be providing. This still image shows you the 3D data the Natal system may be receiving. However, turning this bunch of pixels into a reasonably accurate model of the human body is, as Johnny points out, really amazing.
My previous post on Microsoft's 3D system gaming system 'Natal' questioned the 3D system's latency. In this fresh real-world demo on the Jimmy Fallon TV show, Kudo specifically aimed to demonstrate the 'low latency' of the system. I'm not sure if the red jumpsuits were related to demoing the system, but the system seemed very robust, and responsive enough for fun gaming. I think Microsoft has a winner here.
UPDATE: Via Engadget Apparently the red "suits were just for fun"
UPDATE 2: Video got pulled down, sadly. I'm trying to find a replacement to embed.