A new video from Microsoft Research shows a handheld projector system augmenting an indoor space, creating a digital simulation overlay in real-time. Using pico projectors and Kinect cameras, the research team have been able to develop technology that is ‘aware’ of, and lets you interact with, this virtual environment.
The handheld projector has sensors that give it spatial awareness, so it knows where it is in the 3D space as it is moved around. It also has geometry awareness, so it knows where objects and surfaces are positioned, as well as a person’s gestures and movement. This interactive augmented reality environment was created for the Pervasive conference next year and is a collaborative project between the Microsoft Research team in Cambridge, Lancaster and Newcastle Universities. Take a look at the projector in action: