Toccata is an interactive on-screen installation designed by Angelo Semeraro, a computer science grad working at Fabrica, Benetton’s research center in Italy. The immersive display is based on the illusion of playing with the forces of a physical environment. The application, developed using openframeworks and 2 dimensional physics simulator engine Box2d, features a digital textile that moves and twirls as people walk past Benetton’s window.
When the visitor walks by, a textile reacts to movement, changing its form and giving the perception of modifying the equilibrium of the environment. An arpeggio of sine tones and noises is generated to give supporting feedback to the user’s physical movement.
The video below shows a test of Toccata using ballet footage: