menu
Get a daily delivery of PSFK
Subscribe to get a daily digest of new ideas and discoveries and to find out about upcoming events

Virtual Assistant Avatar Delivers Messages With Human Emotions [Video]

Virtual Assistant Avatar Delivers Messages With Human Emotions [Video]

'Zoe' is a digital talking head created by the Cambridge Research Lab and the University of Cambridge’s Department of Engineering.

Emma Hutchings

Researchers at Toshiba’s Cambridge Research Lab and the University of Cambridge‘s Department of Engineering have collaborated to develop a digital avatar that can express a full range of human emotions. ‘Zoe’ is a virtual “talking head,” which could be used as a digital personal assistant or for “face messaging.”

The lifelike face can appear happy, sad, angry, tender, afraid, neutral or a combination of these emotions. Users can type in a message and indicate what emotions it should have, and it will recite the text.

The face is that of Zoe Lister, a TV actress, who helped train the speech model. The researchers spent several days recording her speech and facial expressions in order to recreate her face and voice.

Virtual Assistant Avatar Delivers Messages With Human Emotions [Video]

They collected a dataset of thousands of sentences and tracked her face while she was speaking using computer vision software. In the future the system, which is light enough to work in mobile technology, could enable people to upload their own faces and voices to personalize their own emotionally realistic digital assistants.

The researchers are currently working with a school for autistic and deaf children, where the technology could be used to help them understand emotions and lip-read. It could also have uses in gaming, audio-visual books, online lectures, and other user interfaces. You can meet Zoe in the video below:

University of Cambridge

Post Image
Read More Tap to Expand
PSFK CONFERENCE 2015

Live. Work. Play. Better.
The PSFK 2015 conference experience

NEW YORK, NY | April 16-April 18 2015
Get a daily delivery of PSFK
TREND REPORT

PSFK Labs presents
The Future of Retail 2015

A Manifesto To Reinvent The Store