menu

Google Has Begun Replacing Apps With Neural Networks

Google Has Begun Replacing Apps With Neural Networks
AI

Google is advancing its AI capabilities to give 'ambient awareness' to the Pixel 2 phone

Jennifer Passas
  • 23 february 2018

Google is making phones smarter with machine learning—and essentially replacing apps with a more advanced operating system. Now Playing, a new feature for the Pixel 2 phone, is essentially a new-and-improved Shazam: it is constantly listening and able to match 70,000 songs without help from the internet.

Instead of users having to ask what song is playing in the background, Now Playing shows the answer immediately on the phone’s locked screen. Google is calling this anticipatory technology “ambient awareness,” which took years of development. Since the audio matching is done on the phone rather than the cloud, a database is needed. In order to ID a song, it must match an audio fingerprint stored in the phone’s database.

The researchers who created Now Playing first built a database of 70,000 sound fingerprints that are a snapshot of a song’s waveforms. To do so, they used a neural net that transformed audio fingerprints into recognizable and unique tiny files. This was difficult because the audio fingerprint had to have enough data to be useful with distorted samples.

When sound comes into the phone it is filtered by the Pixel’s DSP chip, which is a low-power chip that listens for activation words like “Okay Google.” The DSP is constantly listening until it recognizes music. Once music is recognized, the DSP activates the Pixel’s processor, which runs the Now Playing neural network. Within a few seconds the algorithm tries to match the incoming fingerprint with the songs in the phone’s database.

Researchers at Google feel that more opportunities to activate AI on a device are on the horizon. While some functionality will always rely on the cloud because of its big database, there are others that could take advantage of the neural network.

Google Now Playing


Lead Image: Adrien | Unsplash

+artificial intelligence
+Entertainment
+Google
+mobile
+neural network
+product experience

More in Entertainment

Entertainment

Solange Knowles Created A Spellbinding Dance Performance For Uniqlo

Solange's performance piece combines dance, sculpture and the Japanese retailer's newest fashions

20 April 2018
Entertainment

How Brands Are Enhancing Fictional Narratives With Real-Life Immersion

From Star Wars to indie projects, entertainment companies are extending their reach by creating fully immersive experiences that let fans live out their favorite narratives

20 April 2018

The Latest

Event

PSFK’s CXI 2018 conference brings to life key trends in customer experience through talks and activations by pioneers at well known and new companies.

May 18, 2018 | New York City
Expert

Evan is the co-founder and CEO of Snapchat, a platform for people to maintain the spontaneity of social messaging without having to worry about managing a persistent and constant online identity. Released in 2011, the app lets users take photos, record short videos, add text and drawings and send them to a controlled list of recipients. The content is permanently deleted after being viewed. According to Snapchat, in May 2014 the app's users were sending 700 million photos and videos per day, while Snapchat Stories content was viewed 500 million times per day. Prior to founding Snapchat, Evan worked as a software developer at Intuit and attended Stanford University.

Video

Christina Agapakis of Ginkgo Bioworks describes how the incredible feats of biology can be integrated into human-driven design. For more head over to psfk.com

September 27, 2017
No search results found.