The ‘Project Paperclip‘ photography exhibition in Portugal is using augmented reality and QR codes to enrich the viewer experience, demonstrating applications for the technology in the fine arts. The concept, by Portuguese photographer Nuno Serrão, aims to give visitors a different interpretation of the photographs on display by using soundscapes to create a multisensory experience that is reactive and adaptive.
The experience is unique each time it is activated as the app’s algorithm utilizes real-time processing of variables from the visitors location, such as: the time of day, the level of noise that exists in the room, your voice, the movement and localization of the user, amongst many others.
After downloading the Project Paperclip iPhone app, visitors can scan the photographs’ QR code to unlock the soundscapes for each one. Those who can’t make it to the exhibition can try out the app online, where three of the photographs are displayed, and also check out the video below: