Kinect-Powered Sign Language Converter Helps The Deaf Converse

Kinect-Powered Sign Language Converter Helps The Deaf Converse

Japanese researchers create a new way for normal listeners and the hearing-impaired to communicate.

Ross Brooks
  • 10 september 2013

Researchers in Japan are starting to develop a system that recognizes sign language and automatically converts it into Japanese characters – only requiring a commercial motion sensor such as the “Microsoft Kinect.”

Mizuho Information & Research Institute Inc and Chiba University aim to improve communications between hearing-impaired people and normal listeners, with plans for a prototype to be available in October 2013, and a full-fledged version in 2014.

The system uses four steps to achieve its goal:

  1. Senses the movements of the signer’s forearm (wrists, elbows, etc)
  2. Compares the movements with motion data for each word
  3. Automatically estimates the meanings of the movements
  4. Displays Japanese characters on a monitor in real time.


Mizuho Information & Research Institute will be responsible for the application of the system, while Chiba University will offer a technique to recognize sign languages and prepare motion data for each word.

If the system reaches fruition, it could provide an ingenious new way for hearing-impaired people and normal listeners to interact, without having to spend months, or possible years, learning sign language. This is especially true when any kind of web-based communication is involved, making the use of microphones highly improbable.


Chiba University


Dubai And The Future Of Humanitarian Design

Design & Architecture
Technology Yesterday

Fragrance Will Release The Smell Of Data If Your Private Information Is Being Leaked

The device is designed to create a physical cue for the potential dangers lurking online

Retail Yesterday

LYNK & CO Is A New Auto Brand That Promises Mobile Connectivity On Wheels

Online access and mobility sharing are driving the company to disrupt the auto industry


Get PSFK's Related Report: Future of Automotive

See All
Gaming & Play Yesterday

Nintendo’s New Console Pushes For Portable Gaming

The Switch allows gamers to seamlessly play on the go by themselves or with friends

Related Expert

Emily Pilloton

Social Innovation Pioneer

Entertainment Yesterday

Speaker Displays Song Lyrics As Music Is Played

The device is able to generate the graphics on a translucent screen and retrieve the words from a connected database

AI Yesterday

Travel Assistant Scans Your Emails To Make Planning Easier

This AI add-on will sync with your inbox and sends reminders to make sure you don't miss anything important

Millennials Yesterday

FOMO Survival Kit Helps Millennials Cope With Social Anxieties

The satirical product is meant to be a playful diversion for people who feel like they are missing out


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed Yesterday

Health Expert: Nutritional Meal Replacements Are A Solution To Corporate Wellness

Ample Foods Founder Connor Young explains why supplements are the next food trend coming to the workplace

PSFK Labs Yesterday

PSFK Picks: Top 5 Performance-Enhancing Wearables

Our new report looks at innovations pioneering the future of performance through intelligent activewear and predictive analytics

Food Yesterday

New York Restaurant Uses Tomato Sushi As Its Newest Meat Alternative

fresh&co is using sous vide Roma tomatoes to create a vegan option that has the texture and taste of tuna

Advertising Yesterday

Red Bull Converts Sao Paulo Payphones Into Data-Driven Bus Schedules

The booths allow city residents to check local transit times through a simple toll-free phone call

Retail Yesterday

Why Experiential Events Could Replace Trade Shows

Marketers are seeking creative and impactful new ways to connect with influencers

Children Yesterday

Modular Kit Teaches Kids How To Make Their Own Robots

MODI features magnetic modules and a platform for programming to encourage experimentation

Infants Yesterday

Work Table Doubles As A Baby Seat

Designer Kunsik Choi created the furniture to facilitate emotional communication between between parents and their children

Technology Yesterday

Album Turns Into Something New Each Time It’s Streamed

Bill Baird's new album explores the relationship between time and music through a website crafted by design team, One Pixel Wide

Technology Yesterday

Wearable Device And Lamp Recreate Beautiful Sunsets In Your Home

Sun Memories can record up to six hours of natural light and reproduce it via a connected light at a later date

Design & Architecture Yesterday

Flower Pencils Create Cherry Blossom Petals When Sharpened

A Japanese stationary company developed the special implements in order to create unique shavings

No search results found.