Sonic Interface Offers New Methods Of Interaction And Consumer Engagement [Need To Know: SXSWi]

Sonic Interface Offers New Methods Of Interaction And Consumer Engagement [Need To Know: SXSWi]

PSFK is following five trends during SXSWi, we chat with an innovator in this space who explains how audio content recognition is enlarging the potential of the retail market.

Dan Gould
  • 10 march 2012

As we all begin to look forward to the Interactive section of South By South West in March, PSFK has identified five key trends that readers should be monitoring during the festival. One of these trends we have coined ‘Sonic Interface.’

The pervasiveness of electronics in virtually every aspect of daily life has prompted designers to rethink the way that people interact with their devices and the world around them. The next evolution of natural user interfaces sees voice and audio recognition technologies capable of reacting to spoken commands and audio cues, enabling people to perform a wider variety of instant, hands-free operations–from searching for information to surfing the channels.

To explore this idea further, we spoke with David Jones, EVP Marketing at Shazam Entertainment.

What do you think is driving this trend of ‘sonic interface’?

Audio content recognition is not just about handsfree — although this is a fantastic leap forward for all consumers in so many use cases. Applying technologies like Shazam’s audio content recognition, whether it’s pre-recorded or live audio or video content, audio content recognition can simply be a faster, easier way to start a journey or get something done. It’s all about reducing friction, and overcoming consumer inertia — and there is a ton of it out there.

When a consumer users Shazam to identify a song that’s playing, that’s something that you couldn’t do before Shazam came along, or could take you literally hours to figure it out. On top of that, you can buy the track or album in an instant, literally just a password away at most on the iPhone. It’ so easy, that’s why 8% of people who use Shazam with music go on to buy the track or the album, making Shazam the largest mobile affiliate for iTunes, selling over $100 million in digital goods per year through our partners.

When it comes to Shazam for TV — the payoff for consumers is different. You’re not trying to identify what you’re watching (in most cases), it’s about interactivity and engagement. Again, Shazam makes it easy and fast to quickly identify what you’re watching, whether it’s the Super Bowl, a TV show, or a TV ad, and instantly — and automatically — the consumer is immersed in a curated, rich, satisfying experience. For TV shows and events, it’s about going deeper to experience more — getting more information, engaging in additional bonus content, sometimes exclusive content. For TV ad campaigns, it’s about providing more information, special offers, finding the nearest location to buy the product, or best of all — shopping from your couch.

But even if it’s all available today online, and if you’re lucky, it’s available at mobile-optimized sites like what NBC Universal has built for all of its shows, Shazam’s and audio content recognition is essentially competing with:

  • a consumer remembering what they want, launching a browser, and typing in a Google search or a URL [Whew, I am already tired just thinking of that.]
  • A telephone number that you have to remember or write down, and then actually take the time to call.
  •  An SMS short code (more common in Europe and Asia)
  • And even occasionally you’ll see a QR code on-screen, where you have to find and launch an app, then line up and aim the camera at the code, trying to capture it.

All of this takes time. Many people don’t do these things because of the effort involved. Imagine if ACR can streamline this process and get you more quickly where you want to go? That’s what’s exciting about this. And, it’s not just that you made things easier and faster for those who were going to do it “the hard way…the classic way” — but that there is an uplift that will come from consumers who wouldn’t do it before, but will do it now that it is so easy. That’s additional consumers and engagement that would not have otherwise happened simply due to friction and inertia. These are previously lost opportunities for engagement, interactivity and conversion — these are new, thanks to technology like Shazam’s.

Future advances in this technology point to emerging applications in areas ranging from security to personal health care, In your opinion, what are the areas we could see big change using sonic control?

Entertainment and Advertising are two massive industries that can absolutely benefit from these new technologies.

Interactive television using Audio Content Recognition (ACR) technology can be used for special promotions and hidden content – such as exclusive videos and interviews – by providing a click-through to a brand mobile web experience where viewers can interact directly with branded content. Because the tagged item remains in the viewers tag list, they can revisit it and share it with friends long after the television show or ad has ended, extending the viewing experience beyond the 30-second commercial or the 30- or 60-minute television program.

What talks and events should PSFK readers be looking out for in Austin in terms of ‘sonic interface’?

To hear more about how audio content recognition technology is driving consumer engagement with television shows and events, I’d recommend “TVEngagement: Does Social Media Drive TV Ratings?” which will be Friday, March 9, 2:00PM – 3:00PM, Omni Downtown, Capital Ballroom. Come hear what MTV Networks, Bravo Network, Food Network, and Shazam Entertainment have to share on this topic.

Thanks David!


Check out our Guide to SXSWi to get more information about the Need to Know Trends we’re following this weekend.


PSFK's Workplace Vision: How The Nurturing Of Seeds Will Come To Define The Onboarding Process

Brand Development
Work Today

Editorial Roundtable: The Arrival Of The People-First Workplace

Managed By Q, Soma, Workbar, Primary and thinkPARALLAX enumerate the reasons why companies need an employee-embracing workforce in order to exist

Arts & Culture Today

Transforming Light Waves Into A New Art Form

An artist uses glass treated with layers of metallic coatings to create a unique installation called lightpaintings


Get PSFK's Latest Report: Future of Retail: Technology Primer

See All
Design Today

This Windbreaker Lets You Explore The Outdoors While Charging Your Phone

The apparel includes solar panels that allow the wearer to stay connected through the power of renewable energy

Asia Today

The Goal Of This Game Is To Not Get Laid Off From Your Job

A hit mobile app has you working really, really hard to not get fired as you climb the corporate ladder


Morgwn Rimel

Living Intelligently, Living Well

Advertising Today

Movie Critic Bot Guides Viewers Through Festival Offerings

The Toronto International Film Festival has created a Facebook Messenger chatbot to help attendants curate their schedule

Food Today

Disable Your Wi-Fi For Family Dinners With This Pepper Grinder Hacking Device

Dolmio has created a gadget that shuts down internet access so you can eat without being distracted

Entertainment Today

Nosulus Rift Delivers Horrible Smells Just For The South Park Videogame

Ubisoft has developed a unique peripheral for the upcoming title that will put players to the test


Future Of Work
Cultivating The Next Generation Of Leaders

PSFK Op-Ed august 24, 2016

Why Building Better Offices Is The Key To Employee Engagement

Interaction Designer and Audio-visual Technologist at ESI Design illustrates the value in creating environments filled with surprise and delight

PSFK Labs august 24, 2016

PSFK’s Workplace Vision: The Annual Review Becomes An Everyday, Collaborative Activity

Our Future of Work vision is a web-based platform through which teams can collaborate on and monitor performance reviews across all channels, ensuring a happier workplace

Europe Today

Netflix’s Newest Programming Is As Slow As It Gets

Norwegian network NRK is coming to the streaming platform with their successful 'Slow TV'

Media & Publishing Yesterday

CNN Launched An Entire Drone Division Of Their News Network

CNN AIR incorporates aerial footage into the corporation's ongoing news coverage

Advertising Yesterday

Uber’s Breathalyzer Cards Let You Know If You Are Sober Enough To Drive

A new campaign from the ride-sharing service raises awareness about the importance of a safe trip home

Design Yesterday

Milk Proteins Could Be The Packaging Material Of The Future

A newly discovered casein-based alternative is biodegradable, sustainable and even edible

Technology Yesterday

Intel’s New System Will Help Technology See And Understand The World

Joule is a tiny board for developers designed to bring powerful computer vision to cheap and easy-to-make prototypes


Innovation Debrief: Boston
Business Concepts Born In 'The Hub'

Design Yesterday

This LA Hotel Is Designed Specifically For Cocktail Drinkers

The Walker Inn is a new Los Angeles "Bed and Beverage" experience that offers guests an intimate setting for their night cap

Education Yesterday

Bringing Virtual Reality And Telepresence Robotics To E-Learning

This Learning Management System is embracing new technologies to reallocate teaching resources to where they should be going

Advertising Yesterday

Interactive Art Exhibition For Dogs Provides Endless Fun

Installations created by artist Dominic Wilcox are based on activities loved by canines, such as fetching tennis balls and splashing in water

No search results found.