Facial recognition technology makes composing melodies seem effortless.
This year’s NYU ITP Winter Show gave many developers a platform to share their creative visions and talents. One designer, Max Ma introduced a Kinect-based program that uses cameras and sensors to track up to 64 points on a person’s face. Using facial movements like twitches and eyebrow raises to create music, the system lets music lovers compose digital tunes without any hand-eye coordination.
Touchless is programmed to pick up on the slightest head and facial movements, but a wave of your hand will also activate a lovely lead melody. Ma understands the versatility of Touchless—which can be used to open doors with a series of blinks and winks—but chooses to use the technology in a more entertaining way, making it a treat instead of just another gadget.
It’s hard not to smile when you see people widening their mouths and awkwardly tilting their heads just to make music. Below is the demo video for Touchless, have a look.