Piano Reflects Player’s Hands Back To Them During Virtual Lessons [Video]

Piano Reflects Player’s Hands Back To Them During Virtual Lessons [Video]

Visual projections on the keyboard aid in improving skills.

Serena Chu
  • 10 january 2014

The fluid hand gestures and movements made across the piano keyboard are equally mesmerizing as the harmonics that are simultaneously created. To give meaning to this unique style of motion, researchers at the MIT Media Lab developed an interface for the piano that visualizes a “ghost” performance. Entitled MirrorFugue, the project takes the reflection on the lacquered surface of the piano and displays its unaltered entirety on top of playing keys.

piano 2

Based on the idea that visual representations enhance understanding and synchronisation, MirrorFugue offers students a valuable, remote learning experience. With this technology, teachers no longer need to partition their time. Instead, they can record their lessons and have students playback recordings to comprehend different techniques.

Using wide-angle cameras and MaxMSP/Jitter, Xiao Xiao, the mastermind behind the project, communicated the audio and sound in a 640 x 480 video shot at 30 frame per second. In order to simulate the conditions of remote correspondence for the experiment, she invited two people to play in the same room without visual sightings of each other.

While the project is merely a prototype, it offers a glimpse of what the future holds for musicians. This intimate emotional expression demonstrates excellent interdisciplinary innovation and a mastery of digital design.

See the visual of the project below, it is absolutely surreal.


Source: Creative Applications


Brand Engagement At The Gates Of The World's Largest Open-Air Gallery

Asia Yesterday

Safe Drivers Rewarded In Japan With Free Coffee

Driving Barista is a new app that encourages Japanese motorists to put their phones down as they drive

Arts & Culture Yesterday

Michael Kors Has Designed Their Own Instant Camera

In a partnership with Fuji, the limited edition Instax Mini 70 comes in an exclusive metallic gold color


Get PSFK's Related Report: Future of Automotive

See All
Health Yesterday

Manage Your Emotional Health Through Your Phone

Pharmaceutical company Pfizer has created a new iOS app meant to help patients track mental progress and set goals

Food Yesterday

Delete Food Pics Off Of Instagram To Feed The Hungry

Land O'Lakes and Feeding America are donating meals for every picture of a meal taken off of the social platform

Related Expert

Meredith Perry

Wireless Technology, Mobile, Technology

Design & Architecture Yesterday

This Shape-Shifting Pod Could Be The Future Of The Cubicle

MIT and Google have designed a new form of work enclosure meant to offer privacy in open-office layouts

Advertising Yesterday

Billboard Spies On People As They Walk By

To promote the movie "Snowden," the advertisement broadcasts information on passersby without their knowledge

Fashion Yesterday

Anti-Pollution Scarf Helps Cyclists Ride Through Cities

An innovative system filters pollutants and its accompanying app monitors quality of the air


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed september 27, 2016

Modern Workplace Culture: No More Fat Cats Or Kissing Ass

Samar Birwadker, CEO & Co-Founder of Good & Co, on designing shared organizational values to optimize employee happiness and success

PSFK Labs Yesterday

New Mentorship Ecosystems Benefit All Levels Of An Organization

PSFK’s Future of Work report explores how technology is being leveraged to support cross-team communication

Automotive Yesterday

Volvo’s Self-Driving Trucks Will Soon Be Put To Work In An Underground Mine

The fully-automated vehicles are part of a development project to help improve safety for workers

Op-Ed Yesterday

Energy Expert: How American Consumers Are Taking Control Of Their Power Use

Jennifer Tuohy, green tech expert at The Home Depot, discusses green home technologies and developments for renewable technologies in US homes

Work Yesterday

Editorial Roundtable: How Will Companies Staff The Workplace Of The Future?

Managed By Q, Soma, Workbar, Primary, AltSchool and thinkPARALLAX examine the ways that a people-first workplace might disrupt the job hiring process

Arts & Culture Yesterday

Mischievous Drone Will Drop Paint-Filled Balloons On Targets Of Your Choosing

A German photography team developed the flying device to accurately deliver a payload wherever needed


Future Of Work
Cultivating The Next Generation Of Leaders

Fashion Yesterday

100 Backpacks Made For The World’s Top Influencers

Heineken and TUMI have collaborated on a unique custom NYC-inspired bag

Financial Services Yesterday

This Peer-To-Peer Insurance Company Is Powered By Bots

Lemonade is a new product designed to lighten the paperwork and provide instant, helpful service when needed

No search results found.