Sonic Interface Offers New Methods Of Interaction And Consumer Engagement [Need To Know: SXSWi]

Sonic Interface Offers New Methods Of Interaction And Consumer Engagement [Need To Know: SXSWi]

PSFK is following five trends during SXSWi, we chat with an innovator in this space who explains how audio content recognition is enlarging the potential of the retail market.

Dan Gould
  • 10 march 2012

As we all begin to look forward to the Interactive section of South By South West in March, PSFK has identified five key trends that readers should be monitoring during the festival. One of these trends we have coined ‘Sonic Interface.’

The pervasiveness of electronics in virtually every aspect of daily life has prompted designers to rethink the way that people interact with their devices and the world around them. The next evolution of natural user interfaces sees voice and audio recognition technologies capable of reacting to spoken commands and audio cues, enabling people to perform a wider variety of instant, hands-free operations–from searching for information to surfing the channels.

To explore this idea further, we spoke with David Jones, EVP Marketing at Shazam Entertainment.

What do you think is driving this trend of ‘sonic interface’?

Audio content recognition is not just about handsfree — although this is a fantastic leap forward for all consumers in so many use cases. Applying technologies like Shazam’s audio content recognition, whether it’s pre-recorded or live audio or video content, audio content recognition can simply be a faster, easier way to start a journey or get something done. It’s all about reducing friction, and overcoming consumer inertia — and there is a ton of it out there.

When a consumer users Shazam to identify a song that’s playing, that’s something that you couldn’t do before Shazam came along, or could take you literally hours to figure it out. On top of that, you can buy the track or album in an instant, literally just a password away at most on the iPhone. It’ so easy, that’s why 8% of people who use Shazam with music go on to buy the track or the album, making Shazam the largest mobile affiliate for iTunes, selling over $100 million in digital goods per year through our partners.

When it comes to Shazam for TV — the payoff for consumers is different. You’re not trying to identify what you’re watching (in most cases), it’s about interactivity and engagement. Again, Shazam makes it easy and fast to quickly identify what you’re watching, whether it’s the Super Bowl, a TV show, or a TV ad, and instantly — and automatically — the consumer is immersed in a curated, rich, satisfying experience. For TV shows and events, it’s about going deeper to experience more — getting more information, engaging in additional bonus content, sometimes exclusive content. For TV ad campaigns, it’s about providing more information, special offers, finding the nearest location to buy the product, or best of all — shopping from your couch.

But even if it’s all available today online, and if you’re lucky, it’s available at mobile-optimized sites like what NBC Universal has built for all of its shows, Shazam’s and audio content recognition is essentially competing with:

  • a consumer remembering what they want, launching a browser, and typing in a Google search or a URL [Whew, I am already tired just thinking of that.]
  • A telephone number that you have to remember or write down, and then actually take the time to call.
  •  An SMS short code (more common in Europe and Asia)
  • And even occasionally you’ll see a QR code on-screen, where you have to find and launch an app, then line up and aim the camera at the code, trying to capture it.

All of this takes time. Many people don’t do these things because of the effort involved. Imagine if ACR can streamline this process and get you more quickly where you want to go? That’s what’s exciting about this. And, it’s not just that you made things easier and faster for those who were going to do it “the hard way…the classic way” — but that there is an uplift that will come from consumers who wouldn’t do it before, but will do it now that it is so easy. That’s additional consumers and engagement that would not have otherwise happened simply due to friction and inertia. These are previously lost opportunities for engagement, interactivity and conversion — these are new, thanks to technology like Shazam’s.

Future advances in this technology point to emerging applications in areas ranging from security to personal health care, In your opinion, what are the areas we could see big change using sonic control?

Entertainment and Advertising are two massive industries that can absolutely benefit from these new technologies.

Interactive television using Audio Content Recognition (ACR) technology can be used for special promotions and hidden content – such as exclusive videos and interviews – by providing a click-through to a brand mobile web experience where viewers can interact directly with branded content. Because the tagged item remains in the viewers tag list, they can revisit it and share it with friends long after the television show or ad has ended, extending the viewing experience beyond the 30-second commercial or the 30- or 60-minute television program.

What talks and events should PSFK readers be looking out for in Austin in terms of ‘sonic interface’?

To hear more about how audio content recognition technology is driving consumer engagement with television shows and events, I’d recommend “TVEngagement: Does Social Media Drive TV Ratings?” which will be Friday, March 9, 2:00PM – 3:00PM, Omni Downtown, Capital Ballroom. Come hear what MTV Networks, Bravo Network, Food Network, and Shazam Entertainment have to share on this topic.

Thanks David!


Check out our Guide to SXSWi to get more information about the Need to Know Trends we’re following this weekend.


Modular System Lets Musicians Create Their Own MIDI Controllers

Arts & Culture
Travel Yesterday

Mercedes Reveals Dazzle-Free LED Headlights

Digital Light offers great precision with a resolution of over two million pixels

Product Launch Yesterday

Nissan Is Testing A Digital Car Sharing Program In Europe

Nissan plans to launch their new service in Paris sometime this year to trial the profile-matching service


Get PSFK's Related Report: Future of Retail 2017

See All
Social Media Yesterday

Your Favorite Tweets Are Now Wearable

This temporary tattoo allows fans to wear their most favorite moments from the social platform

Health Yesterday

This Mirror Tracks Your Dark Circles And Fine Lines

HiMirror is a device snaps a photo of your face every day to provide feedback on how to care for your skin

Related Expert

Steve Dennis

Marketing Consultant

Sustainability Yesterday

Biodegradable Furniture Made From Pine Needles Could Be The Next Phase Of Sustainable Living

Premiering at Dutch Design Week 2016, the collection fully utilizes an often wasted material

Retail Yesterday

Creative Director: Navigating The New World Of Founder-Brands

Richard Smith, Creative Director at Sullivan, explains how visionaries like Elon Musk and Mark Zuckerberg approach their branding and why it’s important to apply brand thinking to founders’ products

Syndicated Yesterday

Madrid's 'Robin Hood' Cafe Charge The Rich To Feed The Poor

The charity restaurant makes money from customers by day to offer homeless people meals at night


Future Of Retail 2017
Transformation Strategies For Customer-First Business

PSFK Op-Ed december 5, 2016

VP: Why Messaging Apps Are Issuing In A New Era Of Commerce

Matt Johnson discusses how mobile messaging commerce is creating a different modality for interaction between retailers and consumers

PSFK Labs december 1, 2016

Retail Spotlight: Home Depot Reimagines How Employees Conduct Tasks

The home improvement retailer puts the customer first by initiating local fulfillment centers and simplifying freight-to-shelf inventory management

USA Yesterday

Amazon Launches Cashier-Free Store For Ultimate Efficiency

The retailer is looking to make shopping even faster by letting customers instantly pay as they walk out the door

Augmented & Virtual Reality Yesterday

Marble-Like Mini-Worlds Invade Miami Art Week And Your Mobile Screen

The gallery world's sphere of influence seems to be expanding into the realm of Pokémon Go—why that's a good thing

Technology Yesterday

A 'USB Stick' That Can Detect HIV Levels

The simple device developed at Imperial College London measures viral load in less than 30 minutes

Customer Retention Yesterday

Crafting The Personalized Retail Experience

Marriott International's Christopher Baer shares insights into how the hospitality company is strategizing customer service

Retail Yesterday

Zagat's Cafe Offers Tiny Replicas Of Classic NYC Dishes

The restaurant rating service created buzz for its new guide and app by opening a tiny food cafe


Conference Built Around Report Launch

Children Yesterday

Experience The White House In Augmented Reality Using A $1 Bill

1600 Pennsylvania Ave. is an AR app designed to help people learn about the history and significance of the United State's capital building

Travel Yesterday

Portable Computer Monitor Opens Up Like An Umbrella For Travelers

This mobile screen and projector means work can go anywhere and still feel like working from home

Food Yesterday

Starbucks Is Selling An Automated Temperature-Setting Mug

For those looking to keep their coffee hot on their winter commutes, the coffee chain has created a device that keeps beverages exactly at their desire temperature

No search results found.