Kinect Update: PSFK Interviews Microsoft’s Steve Clayton

Kinect Update: PSFK Interviews Microsoft’s Steve Clayton

PSFK chats with the Microsoft storyteller about the tech giant's gesture-based gaming technology, trends in software innovation and the new era for the Natural User Interface.

Valentina Park
  • 21 june 2011

Steve Clayton is the connection between Microsoft’s consumers and the brand itself. He works with people across all levels of the company in order to figure out what’s coming next in the tech world and how Microsoft can best utilize and incorporate that info. From researchers, to cinematographers, to race car drivers, he talks to and formulates updates on the ‘Next at Microsoft‘ website. Recently, Microsoft publicly unveiled the software development kit for their Kinect technology, which is a voice, facial, and motion recognition software that allows the human body or physical objects to work as a game controller, free of charge. Instead of fighting the hacking community, Microsoft opened their arms to welcome all hackers to be creative with their software. We spoke with Steve to find out more details about the code package and what has happened since the its release:

We’ve been seeing developers creating interesting “hacks” with Microsoft’s Kinect for a while now, what have you issued that is any different from what they had in the past?

Part of what we released is code that will help folks “voice-hack.”

Can you explain that a little more – and what opportunities that presents?

To date a lot of the creativity we have seen around Kinect has been gesture based (which is terrific to see) but Kinect has some amazing audio technology too. Check out Listening to Kinect to get a sense of what I mean. Right now, I can control my Xbox using voice, which works particularly well with features such as Netflix or Zune video, enabling me to choose a movie, play, pause, fast forward etc. just using my voice. Imagine driving all manner of other experiences with your voice: search, or controlling appliances in the home or office. It gets even more interesting when you combine modalities — by that I mean the combination of voice AND gesture is very useful and also very natural. Think about when you ask for something in a store and you say “that one,”  you typically point at the same time. The combination of gesture and voice has a lot of untapped potential.

You launched the software update with a ‘Codecamp’ where developers have been creating their own hacks of Kinect with the official Microsoft code. What were some of your favorite projects?

My two favorite projects span the two ends of the tech spectrum. The first is a game of Pong (the classic arcade game) which two guys from Lewis and Clark college reimagined for the future with the body acting as the paddle that hits the ball. Using more contemporary technology, another group took a Quadrocopter and enabled it to be controlled using gestures – it’s impressive stuff that you can see in the video I shot here. This shows what you can do in 24 hours, imagine what we’ll see in 24 days, or 24 months?

Gesture based control seems to have captured developers imagination while 3D TV hasn’t. Both technologies were released about the same time. Is there something about natural user interface that the community embraced? Why isn’t anyone playing with 3DTV?

I’ve not looked (literally) at 3DTV that much myself and I think you’re right, there is something about the natural interface opportunities with Kinect that has captured people’s imagination. The sensor is $150 which makes it pretty affordable and with 10 million units already sold I think we’re just at the beginning of what’s possible with this kind of technology. I think the NUI era truly is upon us.

Next at Microsoft


Thanks Steve!


Machine Printer Uses Coffee Drips To Create Intricate Portraits

Arts & Culture
Technology december 2, 2016

Why Nest Doesn't Get The Holidays

PSFK founder reacts to the damaging effects of poor email marketing

Children december 2, 2016

Robots Could Be Joining Dubai’s Police Force In 2017

The real-life RoboCops can salute, shake hands and collect traffic fines


Get PSFK's Related Report: Future of Retail 2017

See All
Travel december 2, 2016

Parka Hides And Charges Portable Devices

Bolt is a jacket that lets people carry and charge their various electronics without the need for an outlet

Related Expert

Tasha Blank

DJ / Dance Catalyst

Food december 2, 2016

Yelp's New 'Yelfie' Feature Lets Diners Take Selfies

The update is designed to encourage people to attach a selfie when they share their experiences

Design & Architecture december 2, 2016

Build Your Own Savory Cheese Advent Calendar

A British food blogger has created a guide to building a different kind of holiday surprise

Fitness & Sport december 2, 2016

Floating Gym Concept In Paris Is Powered By Your Workout

The proposed design from Carlo Ratti Associati lets passengers ride a stationary bike as they travel through Paris along the Seine River


Future Of Retail 2017
Transformation Strategies For Customer-First Business

PSFK Op-Ed december 2, 2016

Customer Service Expert: Why Offline Retail Has Better Data Than Online Retail

Healey Cypher, Founder and CEO of Oak Labs, shares why we should be thinking about the physical store as an e-commerce site

PSFK Labs december 1, 2016

Retail Spotlight: Home Depot Reimagines How Employees Conduct Tasks

The home improvement retailer puts the customer first by initiating local fulfillment centers and simplifying freight-to-shelf inventory management

Syndicated december 2, 2016

What Does The Future Of Android Look Like In A World With The Pixel?

Google’s decision to make its own phone might have looked like a blow to the likes of Samsung but the reality is much more interesting

Fashion december 2, 2016

Alexander McQueen Designs A 3D-Printed Umbrella

3D-printed fashion arrives in time for the winter season

Work december 2, 2016

Why Training Associates To Be Advocates Is Key To Retail Success

In our Future of Retail 2017 report, PSFK Labs discusses strategies to prioritize customer service, which begins with associate advocates

Media & Publishing december 2, 2016

Netflix Creates Binge Candle To Celebrate A New Season Of Gilmore Girls

The streaming service developed a special layered candle that creates candle with episode-specific smells

Arts & Culture december 2, 2016

Interactive Film Tells A Story About Living With Cancer

A moving song written by a father of a cancer patient comes alive in a 3D environment


Future Of Work
Cultivating The Next Generation Of Leaders

Automotive december 2, 2016

Audi And LEGO Exhibit Autonomous Vehicle Installation

The installation at Design Miami explores the 25th hour, which represents bonus productive work or play time

Gaming & Play december 2, 2016

This Game Lets You Be A Pilot In The Drone Racing League

DRL Racing Simulator recreates actual courses in a virtual environment

Travel december 1, 2016

Hotel Chain Is Giving Away Its Not-So-Super Hotel Art At Art Basel

A lesson in how to advertise a kitschy-to-cool redesign in the middle of Miami Art Week

No search results found.