Kinect Update: PSFK Interviews Microsoft’s Steve Clayton

Kinect Update: PSFK Interviews Microsoft’s Steve Clayton

PSFK chats with the Microsoft storyteller about the tech giant's gesture-based gaming technology, trends in software innovation and the new era for the Natural User Interface.

Valentina Park
  • 21 june 2011

Steve Clayton is the connection between Microsoft’s consumers and the brand itself. He works with people across all levels of the company in order to figure out what’s coming next in the tech world and how Microsoft can best utilize and incorporate that info. From researchers, to cinematographers, to race car drivers, he talks to and formulates updates on the ‘Next at Microsoft‘ website. Recently, Microsoft publicly unveiled the software development kit for their Kinect technology, which is a voice, facial, and motion recognition software that allows the human body or physical objects to work as a game controller, free of charge. Instead of fighting the hacking community, Microsoft opened their arms to welcome all hackers to be creative with their software. We spoke with Steve to find out more details about the code package and what has happened since the its release:

We’ve been seeing developers creating interesting “hacks” with Microsoft’s Kinect for a while now, what have you issued that is any different from what they had in the past?

Part of what we released is code that will help folks “voice-hack.”

Can you explain that a little more – and what opportunities that presents?

To date a lot of the creativity we have seen around Kinect has been gesture based (which is terrific to see) but Kinect has some amazing audio technology too. Check out Listening to Kinect to get a sense of what I mean. Right now, I can control my Xbox using voice, which works particularly well with features such as Netflix or Zune video, enabling me to choose a movie, play, pause, fast forward etc. just using my voice. Imagine driving all manner of other experiences with your voice: search, or controlling appliances in the home or office. It gets even more interesting when you combine modalities — by that I mean the combination of voice AND gesture is very useful and also very natural. Think about when you ask for something in a store and you say “that one,”  you typically point at the same time. The combination of gesture and voice has a lot of untapped potential.

You launched the software update with a ‘Codecamp’ where developers have been creating their own hacks of Kinect with the official Microsoft code. What were some of your favorite projects?

My two favorite projects span the two ends of the tech spectrum. The first is a game of Pong (the classic arcade game) which two guys from Lewis and Clark college reimagined for the future with the body acting as the paddle that hits the ball. Using more contemporary technology, another group took a Quadrocopter and enabled it to be controlled using gestures – it’s impressive stuff that you can see in the video I shot here. This shows what you can do in 24 hours, imagine what we’ll see in 24 days, or 24 months?

Gesture based control seems to have captured developers imagination while 3D TV hasn’t. Both technologies were released about the same time. Is there something about natural user interface that the community embraced? Why isn’t anyone playing with 3DTV?

I’ve not looked (literally) at 3DTV that much myself and I think you’re right, there is something about the natural interface opportunities with Kinect that has captured people’s imagination. The sensor is $150 which makes it pretty affordable and with 10 million units already sold I think we’re just at the beginning of what’s possible with this kind of technology. I think the NUI era truly is upon us.

Next at Microsoft


Thanks Steve!


How Indiegogo Is Becoming An Adult Product Destination

Home september 23, 2016

Watch This Fire Pit Dance Along To Your Favorite Song

Music City Fire is a system that is designed to flicker in time to ambient music

Automotive september 23, 2016

Slick GPS Navigator Gives Directions To Moped Riders

This small, round device attaches to a sideview mirror to display maps for safer traveling


Get PSFK's Related Report: Future of Automotive

See All
Home september 23, 2016

A Clock That Beautifully Manages Your Information Overload

The wall-mounted timekeeper is made to help people maintain focus and stay up to date with their appointments

Arts & Culture september 23, 2016

Performance Piece Blends Dancers Into Folds Of Light

The work provides commentary on the increasing connection between programmed and analog dimensions

Design & Architecture september 23, 2016

Design Firm Adapts Childhood Homes For Unemployed Young Adults

The studio has unveiled three prototypes of transformed living spaces for people forced to move back in with their families

Health september 23, 2016

These Chocolate Squares Claim To Reverse The Aging Process

A group of researchers from Cambridge University have developed a candy bar that promises to give you a youthful glow

Cities september 23, 2016

Food-Producing Architecture Competition Seeks To Better Feed Cities

A design challenge in Copenhagen highlights the need and beauty of urban farming


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed september 21, 2016

Creative Agency Founder: Using VR As A Race Relationship Tool

Maurice Bernstein, CEO and Founder of Giant Step, explores the value in transforming headsets from high-tech entertainment tools into empathy machines

PSFK Labs september 22, 2016

The Future Of Work: Why Innovation Is Every Employee’s Job

PSFK Labs sits down with management at Johnson & Johnson to learn how the company comes up with their next ‘big idea’

Health september 23, 2016

Wearable Monitors Sun Exposure To Prevent Sunburn

The clip monitors UV rays to make sure you're not receiving too much sunlight

Op-Ed september 23, 2016

Productivity Expert: The Magic Of The Five-Hour Workday

Stephan Aarstol, Founder of Tower Paddle Boards, explains why the modern notion of office hours needs to evolve

Culture september 23, 2016

This Exhibition’s Crowning Jewel Is An 18k Gold-Plated Toilet

The piece, titled 'America,' is meant to raise questions about the country's wealth inequality

Culture september 23, 2016

Match Up With Dates On Tinder Based On Your Music Preferences

A new partnership with Spotify lets people pair up based on shared tastes in artists

Entertainment september 23, 2016

Capture, Cut Up, And Configure Your World In 360 Degrees

To meet a booming 360 and VR video-capturing industry, a multimedia software company bolstered its media editing suite for 360-video creation


Future Of Work
Cultivating The Next Generation Of Leaders

Advertising september 23, 2016

These Trucks Drove Around In Circles For 24 Hours To Keep Time

The giant ticking clock was created by 14 Scania vehicles in a deserted airfield

Advertising september 23, 2016

Buy Movie Tickets Directly From Your Facebook Profile

The new feature is part of a campaign from Fandango to further imbed social media into the ticket vendor's digital presence

Asia september 23, 2016

Co-Working Space Brings The Calming Atmosphere Of Nature Indoors

An architectural firm in China has designed a new type of shared office that prioritizes the natural environment

No search results found.