Sonic Interface Offers New Methods Of Interaction And Consumer Engagement [Need To Know: SXSWi]

Sonic Interface Offers New Methods Of Interaction And Consumer Engagement [Need To Know: SXSWi]

PSFK is following five trends during SXSWi, we chat with an innovator in this space who explains how audio content recognition is enlarging the potential of the retail market.

Dan Gould
  • 10 march 2012

As we all begin to look forward to the Interactive section of South By South West in March, PSFK has identified five key trends that readers should be monitoring during the festival. One of these trends we have coined ‘Sonic Interface.’

The pervasiveness of electronics in virtually every aspect of daily life has prompted designers to rethink the way that people interact with their devices and the world around them. The next evolution of natural user interfaces sees voice and audio recognition technologies capable of reacting to spoken commands and audio cues, enabling people to perform a wider variety of instant, hands-free operations–from searching for information to surfing the channels.

To explore this idea further, we spoke with David Jones, EVP Marketing at Shazam Entertainment.

What do you think is driving this trend of ‘sonic interface’?

Audio content recognition is not just about handsfree — although this is a fantastic leap forward for all consumers in so many use cases. Applying technologies like Shazam’s audio content recognition, whether it’s pre-recorded or live audio or video content, audio content recognition can simply be a faster, easier way to start a journey or get something done. It’s all about reducing friction, and overcoming consumer inertia — and there is a ton of it out there.

When a consumer users Shazam to identify a song that’s playing, that’s something that you couldn’t do before Shazam came along, or could take you literally hours to figure it out. On top of that, you can buy the track or album in an instant, literally just a password away at most on the iPhone. It’ so easy, that’s why 8% of people who use Shazam with music go on to buy the track or the album, making Shazam the largest mobile affiliate for iTunes, selling over $100 million in digital goods per year through our partners.

When it comes to Shazam for TV — the payoff for consumers is different. You’re not trying to identify what you’re watching (in most cases), it’s about interactivity and engagement. Again, Shazam makes it easy and fast to quickly identify what you’re watching, whether it’s the Super Bowl, a TV show, or a TV ad, and instantly — and automatically — the consumer is immersed in a curated, rich, satisfying experience. For TV shows and events, it’s about going deeper to experience more — getting more information, engaging in additional bonus content, sometimes exclusive content. For TV ad campaigns, it’s about providing more information, special offers, finding the nearest location to buy the product, or best of all — shopping from your couch.

But even if it’s all available today online, and if you’re lucky, it’s available at mobile-optimized sites like what NBC Universal has built for all of its shows, Shazam’s and audio content recognition is essentially competing with:

  • a consumer remembering what they want, launching a browser, and typing in a Google search or a URL [Whew, I am already tired just thinking of that.]
  • A telephone number that you have to remember or write down, and then actually take the time to call.
  •  An SMS short code (more common in Europe and Asia)
  • And even occasionally you’ll see a QR code on-screen, where you have to find and launch an app, then line up and aim the camera at the code, trying to capture it.

All of this takes time. Many people don’t do these things because of the effort involved. Imagine if ACR can streamline this process and get you more quickly where you want to go? That’s what’s exciting about this. And, it’s not just that you made things easier and faster for those who were going to do it “the hard way…the classic way” — but that there is an uplift that will come from consumers who wouldn’t do it before, but will do it now that it is so easy. That’s additional consumers and engagement that would not have otherwise happened simply due to friction and inertia. These are previously lost opportunities for engagement, interactivity and conversion — these are new, thanks to technology like Shazam’s.

Future advances in this technology point to emerging applications in areas ranging from security to personal health care, In your opinion, what are the areas we could see big change using sonic control?

Entertainment and Advertising are two massive industries that can absolutely benefit from these new technologies.

Interactive television using Audio Content Recognition (ACR) technology can be used for special promotions and hidden content – such as exclusive videos and interviews – by providing a click-through to a brand mobile web experience where viewers can interact directly with branded content. Because the tagged item remains in the viewers tag list, they can revisit it and share it with friends long after the television show or ad has ended, extending the viewing experience beyond the 30-second commercial or the 30- or 60-minute television program.

What talks and events should PSFK readers be looking out for in Austin in terms of ‘sonic interface’?

To hear more about how audio content recognition technology is driving consumer engagement with television shows and events, I’d recommend “TVEngagement: Does Social Media Drive TV Ratings?” which will be Friday, March 9, 2:00PM – 3:00PM, Omni Downtown, Capital Ballroom. Come hear what MTV Networks, Bravo Network, Food Network, and Shazam Entertainment have to share on this topic.

Thanks David!


Check out our Guide to SXSWi to get more information about the Need to Know Trends we’re following this weekend.


IKEA Is Letting Kids Design Its New Line Of Toys

Food Today

Chef Turns Invasive Species Into Delicious Sushi

Creator Bun Lai is adapting strange new ingredients for his menu, which responds to the ecological impact of overabundant creatures in the local environment

Travel Today

Build Your Own Subway System In This Minimalist Game

Mini Metro lets you design your own fully functional transit network, simulating the flow of urban commuters with pared-down visuals


Get PSFK's Related Report: Future of Automotive

See All
Work Today

Keyboard Designed To Help Women Use More Assertive Language

The device is a commentary on gender roles in the workplace, and features easy access to "power verbs" that help reinforce a habit of being direct in writing

Arts & Culture Today

Spanish Artist Dreams Up What Animals Would Look Like In Modern Clothing

Yago Partal's portraits depict the fantasized style preferences of creatures worldwide, from an Arctic wolf to a zebra

Fitness & Sport Today

New Data Technologies Make Hyper-Personalized Training A Reality

The Sports Debrief from PSFK Labs looks at how analytics tools are being developed to optimize human performance across all industries

Technology Today

IBM Watson Helps Grammy-Winning Producer Craft An EP

The computer system's data technology generated musical scores for Alex Da Kid's first solo project

Retail Today

Why The Apple Watch Is Taking Foot In The Restaurant Industry

An app for the wrist-mounted device is looking to revolutionize customer service for staff


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed october 26, 2016

Creative Leadership Expert: Experiencing A Seismic Shift From Brand Loyalty To Interface Loyalty

Marc Shillum, founder of Chief Creative Office, explains why product designers must rethink the way they capture consumer attention

PSFK Labs october 25, 2016

The Keys For Exceptional Performance On And Off The Field

PSFK Labs' new report highlights five important insights for businesses to perform better than the competition

Travel Yesterday

30-Year-Old Photographs Used As Travel Guides

A new photo series revolves around tracing the origins of images from the past

Technology Yesterday

Album Turns Into Something New Each Time It’s Streamed

Bill Baird's new album explores the relationship between time and music through a website crafted by design team, One Pixel Wide

Health Yesterday

VR App Prescribed For Pain Relief

A pharmacy chain in Sweden is stepping away from tradition to develop a happy place for the pain-afflicted

Financial Services Yesterday

Banks Are Coming Together To Create A New Payment Network That Rivals Venmo

A number of financial institutions are collaborating to make a new person-to-person monetary system called Zelle for their customers

Media & Publishing Yesterday

Pocket Camera Aims To Facilitate The Struggles Of Live Streams

The Mevo helps resolve the complexities of streaming video with an intuitive setup and smart editing controls

Health Yesterday

Startup Believes Traceability Will Help Disrupt The Multivitamin Industry

Ritual is a daily supplement for women that traces every ingredient back to its source

Arts & Culture Yesterday

Photo Series Brutally Murders Some Of Your Favorite Fast Food

The portraits by artist duo Ilka & Franz do away with mealtime regulars in a way that is both beautiful and humorous

Mobile Yesterday

Coffeemaker Teaches You How To Make The Perfect Cup

The device comes with an accompanying app that guides novices and experts alike through the brewing process

No search results found.