Steve Clayton: Kinect Powered AR Lets You Interact With Motion Graphics

Steve Clayton: Kinect Powered AR Lets You Interact With Motion Graphics

A new projector-augmented reality mash-up allows you to move and control images and have them react to their surroundings.

Steve Clayton, Microsoft
  • 13 march 2012

Last week I mentioned how closely I follow the work of Hrvoje Benko – he works pretty closely with Andy Wilson. The pair of them always have something interesting cooking in their labs – for Benko last week at TechForum it was the wearable projector, while Andy demonstrated Holoflector. There was one other demo that Andy and Benko showed which I received video of today. Welcome to Beamatron.

Beamatron is an example of the trend we’re exploring that blends the physical world with the virtual world. It’s augmented reality concept that combines a projector and Kinect sensor on a pan tilt moving head – of the kind you may find in a nightclub. The setup utilizes KinectFusion to build a 3D model of a space and enables projected graphics to react in physically appropriate ways. For example a virtual car can be driven around the floor of the room bumping into actual obstacles and running over real ramps. Benko had great fun “driving” the car over my shoes as I stood watching.

The moving head of the projector means the image can be displayed almost anywhere in a room while the depth camera enables the correct projection relative to physical surfaces.

Aside from the fun aspect, another application the team mentioned is the ability to bring notifications and other graphics to the attention of a user by automatically placing the graphics within the user’s view.

Let the blurring of physical and virtual commence!

Originally posted on Next at Microsoft. Republished with kind permission.


Wearable Tech Expert: Designing Technology To Empower Connection To Ourselves

Technology Today

Album Turns Into Something New Each Time It’s Streamed

Bill Baird's new album explores the relationship between time and music through a website crafted by design team, One Pixel Wide

Technology Today

Wearable Device And Lamp Recreate Beautiful Sunsets In Your Home

Sun Memories can record up to six hours of natural light and reproduce it via a connected light at a later date


Get PSFK's Related Report: Future of Automotive

See All
Design & Architecture Today

Flower Pencils Create Cherry Blossom Petals When Sharpened

A Japanese stationary company developed the special implements in order to create unique shavings

Augmented & Virtual Reality Today

The Simpsons Is Stepping Into The World Of VR

To celebrate their 600th episode, the animated family sitcom created a virtual reality version of their opening gag

Related Expert

Beau Trincia

IDEO Design Thinking

Syndicated Yesterday

Museum Exhibit Celebrates Strange Architectural Contraptions

Artist William Heath Robinson's peculiar genius is on display in this recent show with wiggling ducts, jumbles of planks and coils of cable

Food Yesterday

This Sensor Will Help You Brew The Perfect Cup Of Tea Every Time

42Tea is a small device that guides you through every step of the brewing process, even identifying the type of leaves being used

Design & Architecture Yesterday

Norwegian Mountaineering Center Mimics A Snow-Capped Mountain

The structure's exterior is clad in a uniform surface of pixels to create a unique climbing experience


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed october 14, 2016

Everything I Know About Leadership I Learned Teaching 7th Grade Math

Bree Groff, Managing Director at NOBL NYC, shares her secrets for knowing your employees and enabling a team

PSFK Labs october 12, 2016

PSFK Picks: Top 5 Performance-Enhancing Wearables

Our new report looks at innovations pioneering the future of performance through intelligent activewear and predictive analytics

Gaming & Play Yesterday

Shopping Bag Turns Your Hands Into A LEGO

Designers from the School of Visual Arts thought up the Playbox Bag for a competition

Sustainability Yesterday

Giant Coffee Cups Encourage People To Recycle Their Morning Cup Of Joe

The Hubbub Foundation has created a set of themed bins meant to inspire recycling on a large scale

Home Yesterday

Small Device Creates A Personal Weather Station Inside In Your Home

Netatmo's new sensor is a standalone air quality monitor that can measure humidity, purity, noise and temperature

Travel Yesterday

Advertising Proposal Aims To Be The Most “Instagrammable Billboard In The World”

The Belltower in Los Angeles would allow video advertising and live event streaming, and include a pedestrian plaza for visitors

Beauty Yesterday

L’Oréal Wants To Help Visually Impaired Women Apply Makeup

The cosmetics brand has developed a series of audio tutorials for Brazilian consumers with reduced sight

Travel Yesterday

Drone-Powered Hotel Concept Could Radically Redefine Vacations

These unique pods would allow guests to visit a variety of locales over a period of several days

Automotive Yesterday

Pitch Your Startup Idea To Fellow Uber Passengers

A new promotion on the ridesharing service's POOL feature lets select riders compete for a $5,000 investment from prominent venture capitalists

No search results found.