Interactive Tech Allows Users To Influence Overlayed Projections On Buildings

PSFK spoke about the Future Of Gaming with the founder of NuFomer, a 3D mapping firm about how they are bringing a layer of interactivity to urban environments.

The PSFK consulting team has been noticing that the maturation of motion-sensing technologies are enabling new gaming experiences which can support personal growth and development, as gamers use natural movement to interact within a gaming environment.

One company operating in this space is NuFormer–a Netherlands-based 3D video mapping company that has integrated interactivity controls into projection technology. During a recent interactive projection test, spectators interacted in realtime with a projection layered onto a building by using gesture-based tracking (Kinect) technology. Using an iPad, iPhone or web-based application made available for both mobile phone and computer use, people could influence the projected content. For this particular test, Facebook interactivity was used but any type of social media can be incorporated into the projection. All types of branded content, logos or product placement can be incorporated in these interactive projection applications. PSFK spoke with multi-media designer Joren van Suylekom at NuFormer.

Please provide a brief introduction about yourself and your company

About Joren:

Since June this year, I have been part of the creative team of NuFormer. I graduated with a degree in Communication & Multimedia Design in 2009, and after two years of working as a freelancer I decided to join a creative team. I am well-rounded in the business, and besides creating 2D and 3D animations, I do some programming as well.

About NuFormer:

Netherlands-based NuFormer is one of the world’s leading specialists in 3D video mapping on buildings and objects. We are an innovative multimedia agency with many years of experience in the field of design and realization of various digital solutions, branching film and video productions, combined with 3D and 2D motion graphic design.

Committed to exploring the limits of what is technically possible, we continuously experiment with the newest technologies and translate these techniques into original and unique presentations for clients across the globe.

Please tell us about NuFormer-3D Mapping Interactivity Test. What is the idea and goal behind the technology and platform?

After executing 3D video mapping projections onto objects and buildings worldwide, the use of interactivity is the latest addition to this technology. To upgrade the experience of the spectator, NuFormer developed interactive projection applications that can be combined with the 3D video mapping technique. All types of branded content, logos or product placement can be incorporated in these interactive projection applications.

During the interactive projection test the spectators were able to control and interact in real-time with the building by using gesture based tracking (Kinect). People could manipulate the content of the projection by using an iPad, iPhone or a web-based application made available for both mobile phone and computer use. For this particular interactive test we used Facebook, but any type of social media can be incorporated into a 3D video mapping projection.

nuformer-3d-interactivity-test

What has been the audience reaction? Can you share any stats around user engagement?

The spectators were amazed by the scale of the projection and the fact that they could be part of the event, moreover, any change in the color and shape of the façade was triggered by movement of the participants. This not only caused interaction between the participants and the building, but also generated communication between the spectators and participants.

Although the initial setup for this test was small and only a limited amount of people were present to witness the event, the online response afterwards was enormous. News of the test spread quickly; dozens of influential blogs devoted attention to the topic and thousands of people watched the video registration of the test on Facebook, YouTube and Vimeo. This was exactly the reaction we had hoped for, as it showed that people are enormously enthusiastic about this new user-engagement element that can be combined with the spectacular technology of 3D video mapping projection.

We are noticing that the maturation of motion-sensing technologies are enabling new gaming experiences which can support personal growth and development, as gamers use natural movement to interact within a gaming environment. Do you see this trend manifesting on a larger scale?

Thus far, we have only integrated interactive elements, such as motion-sensing technologies, in our interactivity test. Of course this was a 3D production whereby most interaction was aimed at a group, and not an individual. Naturally, this kind of interaction can be very valuable in terms of learning to communicate and cooperate. Yet on the other hand, the audience’s average encounter with our productions are rather short in time and do therefore not really allow for any higher purpose, such as personal growth or development.

Although the general nature of our productions does not really allow for this personal growth element, it is of course very well possible that the combination of 3D video mapping techniques and interactive gaming environments will play a much more important role in the near future in this respect.

What other trends within or around gaming have you noticed?

Stereoscopic 3D videos and games are trending topics, this also influences the field of video mapping. We hope that we can embed this technique in one of our upcoming projections. We have already done several tests whereby we track the position of the spectator and let the perspective of the projected image adapt accordingly, so as to create a real-life 3D situation. This technique is very interesting in combination with stereoscopic 3D.

nuformer-3d-interactivity-test

Thanks Joren!

NuFormer

Quantcast