Natural, versatile man-machine interfaces can be created by
processing live video input from a digital camera. Movements
of either the user or simple hand-held props drive an engaging
entertainment experience. The greatest level of interactivity
can be produced by mixing live video of the user with computer-generated
graphics. The low cost of digital cameras and processors has
recently made such computer vision interfaces viable, even for
a cost-sensitive market such as console gaming.
Richard Marks was an Avionics major at MIT before getting
his PhD at Stanford in the area of visual sensing for underwater
robotics. He then joined Teleos Research, a computer vision start-up
that was later acquired by Autodesk. He departed and consulted
for a year, before the unveiling of the PlayStation2 hardware
inspired him to join PlayStation R&D. His research focus
has been studying real-time video input to the PS2, and he now
manages R&D Special Projects, which includes Man-Machine
Interfaces and Physical Simulation.