Facial recognition technology makes composing melodies seem effortless.

This year's NYU ITP Winter Show gave many developers a platform to share their creative visions and talents. One designer, Max Ma introduced a Kinect-based program that uses cameras and sensors to track up to 64 points on a person's face. Using facial movements like twitches and eyebrow raises to create music, the system lets music lovers compose digital tunes without any hand-eye coordination.

Touchless is programmed to pick up on the slightest head and facial movements, but a wave of your hand will also activate a lovely lead melody. Ma understands the versatility of Touchless—which can be used to open doors with a series of blinks and winks—but chooses to use the technology in a more entertaining way, making it a treat instead of just another gadget.

EXCLUSIVE MEMBER CONTENT
PSFK provides access to this article and every report, case-study, interview, and analysis that we publish for our members. PSFK Professional Membership also unlocks accessto unlimited customized research assistance and our database of over 100,000 insights on innovation trendspanning across eight industry sectors—from culture and brand to retail and customer experience.
Already a members? Log in