The Creators Project: A Breath-Controlled Installation Inspired By Hurricane Sandy

The Creators Project: A Breath-Controlled Installation Inspired By Hurricane Sandy

The organization's team comes up with a project that encapsulate how humans effect the weather.the

Creators Project
  • 1 february 2013

These days, it feels like the worlds of film, gaming and interactive art are collapsing in on one another—video games are starting to become nearly indistinguishable from CGI-enhanced movies, and films and art installations are increasingly inviting viewers to play and interact, no longer content with a passive one-size-fits-all experience. Last December, The Creators Project teamed up with art and technology center Eyebeam and visual effects company Framestore to explore this converging landscape of visual and narrative forms. We brought together 5 teams of filmmakers, creative coders, artists, designers and motion graphics specialists to investigate the future of cinematic storytelling in the New Cinema hackathon.

One team began their exploration into the future of cinema by looking at its past. The earliest beginnings of cinema bear little resemblance to the darkened movie theaters we’ve come to know and expect today. “Early cinema was the ‘cinema of attractions’—it emerged out of physical environments like carnivals and amusement parks… and was an embodied experience used to create illusion,” explains Greg Borenstein, one third of the team behind the New Cinema project We Make The Weather, a breath-controlled interactive work in which the viewer’s breath controls a virtual figure crossing a never-ending bridge over a body of water.

Borenstein and his teammates, Karolina Sobecka and Sofy Yuditskaya, started out with a loose narrative in mind—they took inspiration from the recent events of Hurricane Sandy and wanted to create an experience that would touch on storms, flooding, and rushing water, using both live action and 3D modeled materials. In We Make The Weather, the viewer wears a headset with a microphone sensor that monitors your breath and tracks its ebb and flow, and level of intensity, then uses this information to power the visuals and sound within the 3D animated landscape.

“The departure point for the piece was a reflection on how much influence we humans have on our environment, and on the inevitable contradictions in our attempts to control it,” says Yuditskaya.


For the project, Sobecka constructed a barren, glacier-like virtual environment in Unity 3D, a game engine software popular with interactive artists and visual effects specialists. In it, a ghostly anonymous figure tries to cross a bridge to get to the island on the other side, but can never reach the end as new planks keep getting added to the bridge with every exhale. Yuditskaya composed the sound design, experimenting with white noise loops in PureData to compose the tumultuous storm and water soundscape.

The team also incorporated live captured footage of water into the project through a technique called seam carving, a type of content-aware image resizing that can expand or contract an image by adding or removing rows of pixels from the image.

Their biggest challenge, however, was trying to merge both interactive and narrative elements. “In some ways, the interactive technological context acted as this acid that dissolved storytelling ideas you put into it,” says Borenstein. Nevertheless, he believes that this diffusion of the language of cinema into other mediums, and its adoption of influences from other mediums, is the future—or at least a future—of cinema.

We Make The Weather is on view at Eyebeam Art + Technology Center in New York City through February 2nd. Visit to read more about the hackathon and the other projects developed there.


Originally published on The Creators Project. Republished with kind permission.


PSFK's Workplace Vision: Leave The Busywork To The Bots

Syndicated Today

In Popular Games, The Recurring Theme Is Exploration

The much-hyped sci-fi sandbox game proved to be as massive as expected, while Pokémon Go continued to prove inescapable

Design Today

The Best In Wearable Tech From The Rio Olympics

PSFK rounds out the Rio Games with our picks for the best gadgets and devices used to track performance


Get PSFK's Latest Report: Future of Work

See All
Advertising Today

This Cookbook Is Inspired By Brad Pitt’s On-Screen Eating Habits

Learn how to whip up meals and snacks pulled straight from the actor's fictional universe

USA Today

Tour The US National Parks From The Comfort Of Your Home

Google's new 360-degree video feature lets people take a trip to Alaska, Utah or Hawaii and see these marvels of nature up close

Augmented & Virtual Reality Today

VR Training For Active Shooter Preparedness

SurviVR is an immersive environment to teach civilians how to protect themselves in dangerous situations

Cities Today

Redesigned London Tube Map Aims To Get People Walking

The updated display illustrates approximately how many steps it takes to walk between stations for a healthier commute

Experiential Marketing Today

Nike Creates An Immersive Pop-Up Fitness Experience In London

The Unlimited You space gave athletes a chance to push their limits farther than ever before


Future Of Work
Cultivating The Next Generation Of Leaders

PSFK Op-Ed august 24, 2016

Why Building Better Offices Is The Key To Employee Engagement

Interaction Designer and Audio-visual Technologist at ESI Design illustrates the value in creating environments filled with surprise and delight

PSFK Labs Today

The 10 Steps To Discover, Hire, Develop Your Next Leader

PSFK's Future of Work report outlines key steps in the employee development path to empower next-gen leaders

Automotive Today

Uber Now Lets Commuters Pay With Pretax Dollars

The prepaid cards are a partnership with WageWorks, letting uberPool users save up to 40% on their trip

Home Today

Philips Hue Adds Motion Sensor To Control Lights Automatically

The wireless device lets users interact with their environment without needing to press a switch

Home Today

Beacon Device Takes The Pain Out Of Navigating A New Airbnb

Ping provides new guests with a guided tour of the house or apartment through a simple tap of their phone

Arts & Culture Today

Shelf Makes Its Contents Appear To Hover In Midair

The design uses metal tubes to create an optical illusion when viewed from the front

Arts & Culture Today

Interactive Ceiling Responds To People Walking Underneath

The installation features built-in sensors that cause the undulating surface to morph and react to passersby


Rio Olympics
Innovation Coverage From The Rio Games

Fashion Today

Declutter And Recycle All Of Your Unwanted Stuff

A new app will help catalogue your possessions and give them away as donations when you no longer want them

Advertising Today

Tokyo Concept Store Disguised As A Parking Garage

The retail and cafe project is designed as a hidden treasure for urban explorers

No search results found.