Are We Moving Toward A More Natural Future With Technology?

Are We Moving Toward A More Natural Future With Technology?

Steve Clayton, the editor of the Next at Microsoft blog, shares his thoughts on the growing trend of Natural User Interfaces.

Steve Clayton, Microsoft
  • 31 march 2012

Trend watching has become a profession in recent years and there are sites dedicated to monitoring trends of all kinds. I spend a good deal of my time writing about trends in technology and observing a number of key trends that Microsoft is focused on. Individual trends such as Big Data, the Internet of Things and cloud computing are fascinating on their own—but over the last year it’s become clear to me that a number of trends are maturing and colliding at the same time and helping to fuel one big trend we’re focused on—Natural User Interfaces or NUI. Allow me to explain what NUI is and some of the trends behind it.

In simple terms, NUI is concerned with making technology much more natural to interact with. That may be through voice control of a TV (rather than fumbling with remotes and on screen menus), it may be through playing a video game just using your body with no need to master a controller of any kind, or it may be logging in to a system by simply having the system recognize you. It’s no coincidence that all of these examples are features of Kinect for Xbox 360, which has taken NUI in to 18 million homes in a little over a year. Kinect is a great example of NUI in action—taking advantage of advanced computing capabilities to remove the barriers for interaction. Kinect is just one example though—the touch screen interfaces that we have become familiar with on our smartphones are examples of NUI. Behind Kinect and smartphones there are a set of underlying trends that are enabling natural interaction. Let’s take a brief look at two—the proliferation of sensors and big data.

Kinect contains a number of “sensor”—a series of cameras, including a depth camera that enable Kinect to recognize you–as well as a sophisticated audio array of microphones that can pinpoint your voice, even in a very noisy room. When you stop and think about the number of sensors (or computers of some kind) in your life you begin to notice that there are far more than the traditional devices you often associate with computing. Increasingly our homes are filled with electronics in the form of household appliances, lighting systems, heating systems, alarm systems, even electronic vacuum cleaners. Each of these systems has a degree of intelligence and over time more and more of them will become connected to the Internet and connected together. Our cars already have hundreds of computers and sensors and they’re getting smarter each year. Soon they’ll be connecting to and “talking with” smart streets and cities to help us find a parking space more quickly and pay for it automatically.

Our smartphones are already filled with sensors—GPS, accelerometers, compasses, light meters and more. Some phones already increase the ringer volume when the light sensors detect it’s dark (and assume your phone is in your pocket or bag). As we allow them to, our smartphones are set to get smarter. The GPS knows where we are and the calendar knows where we’re going so perhaps it’ll connect to our car and pre-program the route? All of these scenarios, big or small are examples of our interaction with technology becoming more natural. And all of them generate data—every click, every non-click, every movement, every gesture. Each one is data and the more there is, the more natural technology can become, as we can teach it by example using techniques known as machine learning.

Devices generate data and data enables smarter devices. All of this will lead to more natural ways to interact with technology—and there is another trend we’re very focused on at Microsoft that we believe will help fuel this shift – displays everywhere. We foresee a world where almost any surface can become an interactive display and we’re busy pushing the boundaries with transparently displays, displays that can see as well as project and technology that turns the palm of your hand in to a display.

As this mixture of hardware and software gets woven together, design becomes ever more important. We need to remain focused on designing the appropriate interaction mode. A touch screen TV is no use when you’re sitting ten feet away—but voice control is great. Voice control will become more than a little frustrating if everyone on the subway decides to use it at the same time and gesture controlled gaming isn’t going to work when you’re sitting in seat 27D on an airplane.

I’m excited about the future as sensors, displays and data start to make technology invisible—it’s an entirely new canvas for designing amazing experiences.

For more on the future of natural user interfaces head to

PSFK is thrilled to have Microsoft on board as a sponsor of this year’s PSFK Conference Series.

Click the banner below to purchase tickets and find additional information about this year’s event.


Fitness Advocate: Paving The Future of Workouts With Audio

Fitness & Sport
Advertising Today

A Compelling Brand Purpose Is Never Born In The Boardroom

Strategist and Designer Anna-Rae Morris discusses why all brands must exist to serve a purpose in order to communicate effectively

Retail Today

Creative Leadership Expert: Experiencing A Seismic Shift From Brand Loyalty To Interface Loyalty

Marc Shillum, founder of Chief Creative Office, explains why product designers must rethink the way they capture consumer attention


Get PSFK's Related Report: Future of Automotive

See All
Fitness & Sport Today

Editorial Roundtable: The Xs And Os Of Performance-Enhanced Sports

WHOOP, ShotTracker, Rithmio, PlaySight, STYR Labs, EverybodyFights and Lift / Next Level Floats explain that we're only at the iceberg's tip of performance enhancement

Related Expert

Tan Siok

Filmmaker, Technology, Social Media

Technology Today

Microsoft’s New E-Paper Sticky Note Runs On Ambient Light

Researchers have developed the first e-ink display powered entirely by office bulbs

Sustainability Today

Modern Home Created Entirely Out Of Modular Shipping Crates

A project in Ecuador used the ubiquitous material to design a spacious and industrial-chic house

Retail Today

Retail Concept Offers Food Hall Inspired Space For Online Brands

The store will offer a lower cost way for internet entrepreneurs to try physical retailing


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed Yesterday

Marketing Experts: Millennials And The Power Of Cool

'Good Is The New Cool' Authors Afdhel Aziz and Bobby Jones share their 7 principles for branding with a social impact

PSFK Labs Yesterday

The Keys For Exceptional Performance On And Off The Field

PSFK Labs' new report highlights five important insights for businesses to perform better than the competition

Arts & Culture Today

Disney Retells Beauty And The Beast On Snapchat

In a partnership with LACMA, the entertainment platform drew from over 130,000 works in the museum's collection

Automotive Today

Honda Has 3D Printed A Fully Electric Minivan

The car manufacturer partnered with product developer Kabuku to create the small versatile vehicles

Innovation Yesterday

After The Initial Success Of AR Gaming, What Does The Future Hold?

With Pokemon GO earning up to $10m a day, R&D departments are busy searching for the next phase

Arts & Culture Yesterday

The Next Great Art Movement Will Come At The Swipe Of A Finger

An improved app, optimized digital display and monthly art discovery service round out Electric Objects' renewed commitment to democratizing the art world

Media & Publishing Yesterday

A TV Streaming Service Is Designed Just For Kids

Toca TV is a new platform offering thousands of original and curated children's videos for a monthly subscription fee

Travel Yesterday

Bus Stop Transformed Into A Fitness Station For Commuters

Sports drink company Lucozade live-streamed an athletic trainer working out at a stop in Manchester to encourage travelers to get moving

Beauty Yesterday

Shiseido And Microsoft Have Created A Makeup Filter For Women Who Telecommute

The Japanese cosmetic company built an augmented reality app that works alongside Skype for Business

Mobile Yesterday

Samsung Is Using AR To Help Beachgoers Stay Safe

Pocket Patrol utilizes a phone's camera to promote beach safety and educate people about hidden hazards

No search results found.