Hacked Glasses Translate Foreign Languages Into Subtitles In Real-Time [Video]
Will Powell has developed a way to translate real-time conversations and display the words for the wearer, breaking down the language barrier.
Inspired by Google’s Project Glass, Will Powell rigged Vuzix 1200 Star glasses to translate a foreign language and provide subtitles for the wearer. This technology is able to break down language barriers, enabling the wearer to have a real-time conversation with someone speaking a language they are unfamiliar with. Powell used two Raspberry Pi machines running debian squeeze, a Jawbone mic, headset mic, TV, iPhone, iPad, and transformer, to talk to his Spanish-speaking sister. Here’s how it works:
The individual using the glasses wears the Vuzix 1200 Star glasses which are connected to the s-video connector on the first raspberry pi and the Jawbone bluetooth microphone that connects to a device such as smartphone or tablet to provide a clean noise cancelled audio feed. The bluetooth microphone streams across the network of what I say and what it picks up around me. This is then recognised and passed through Microsoft’s translation API with a caching layer to improve performance of regularly used statements. Passing through this API service is the biggest delay in the subtitles. Once translated the server passes back the text and translations that are picked up by the raspberry pi driving the TV and glasses displays.
Check out the video below to see the technology in use.
Do you have any stories of an app saving the day? PSFK is asking readers to tell us what new technologies or apps you use to sharpen up your business skills? Send us a link to a related innovation that you use or one we might have missed.
Over the next 4-8 weeks we want to start a conversation around what you see as possible in the Future of Work. Be sure to follow the conversation on PSFK and participate in the daily competitions. Tweet us your ideas to @psfk using #FoW.