The Creators Project: A Breath-Controlled Installation Inspired By Hurricane Sandy

The Creators Project: A Breath-Controlled Installation Inspired By Hurricane Sandy

The organization's team comes up with a project that encapsulate how humans effect the weather.the

Creators Project
  • 1 february 2013

These days, it feels like the worlds of film, gaming and interactive art are collapsing in on one another—video games are starting to become nearly indistinguishable from CGI-enhanced movies, and films and art installations are increasingly inviting viewers to play and interact, no longer content with a passive one-size-fits-all experience. Last December, The Creators Project teamed up with art and technology center Eyebeam and visual effects company Framestore to explore this converging landscape of visual and narrative forms. We brought together 5 teams of filmmakers, creative coders, artists, designers and motion graphics specialists to investigate the future of cinematic storytelling in the New Cinema hackathon.

One team began their exploration into the future of cinema by looking at its past. The earliest beginnings of cinema bear little resemblance to the darkened movie theaters we’ve come to know and expect today. “Early cinema was the ‘cinema of attractions’—it emerged out of physical environments like carnivals and amusement parks… and was an embodied experience used to create illusion,” explains Greg Borenstein, one third of the team behind the New Cinema project We Make The Weather, a breath-controlled interactive work in which the viewer’s breath controls a virtual figure crossing a never-ending bridge over a body of water.

Borenstein and his teammates, Karolina Sobecka and Sofy Yuditskaya, started out with a loose narrative in mind—they took inspiration from the recent events of Hurricane Sandy and wanted to create an experience that would touch on storms, flooding, and rushing water, using both live action and 3D modeled materials. In We Make The Weather, the viewer wears a headset with a microphone sensor that monitors your breath and tracks its ebb and flow, and level of intensity, then uses this information to power the visuals and sound within the 3D animated landscape.

“The departure point for the piece was a reflection on how much influence we humans have on our environment, and on the inevitable contradictions in our attempts to control it,” says Yuditskaya.


For the project, Sobecka constructed a barren, glacier-like virtual environment in Unity 3D, a game engine software popular with interactive artists and visual effects specialists. In it, a ghostly anonymous figure tries to cross a bridge to get to the island on the other side, but can never reach the end as new planks keep getting added to the bridge with every exhale. Yuditskaya composed the sound design, experimenting with white noise loops in PureData to compose the tumultuous storm and water soundscape.

The team also incorporated live captured footage of water into the project through a technique called seam carving, a type of content-aware image resizing that can expand or contract an image by adding or removing rows of pixels from the image.

Their biggest challenge, however, was trying to merge both interactive and narrative elements. “In some ways, the interactive technological context acted as this acid that dissolved storytelling ideas you put into it,” says Borenstein. Nevertheless, he believes that this diffusion of the language of cinema into other mediums, and its adoption of influences from other mediums, is the future—or at least a future—of cinema.

We Make The Weather is on view at Eyebeam Art + Technology Center in New York City through February 2nd. Visit to read more about the hackathon and the other projects developed there.


Originally published on The Creators Project. Republished with kind permission.


Lyft Gives Free Rides To Those Who Have Had Too Much To Drink

Augmented & Virtual Reality Today

Outdoor Camp Presented In 360° VR By X Games Gold Medalist

The video features campers riding BMX trails, zip lining through the woods, and performing big-air jumps

Travel Today

Boeing Wants Passengers To Control Their In-Flight Experience Through Their Phones

The airline manufacturer is embracing automation through a new generation of mobile travel apps


Get PSFK's Related Report: Future of Automotive

See All
Augmented / Virtual Reality Today

VR Surgery Videos Offer Interactive Medical Education

Dutch startup MDLinking hopes to globalize communication between students and medical care professionals with virtual reality content

Culture Today

Use Twitter To Learn A New Language

tDict is an app that uses the social media platform to help you search for words in local dialects

Mobile Today

This Startup Wants To Digitize The Loose Coins In Your Pocket

CoinOut is a new app that lets you save your extra change from cash transactions as electronic funds

Advertising Today

McDonald’s Is Accepting Trash As Currency In Exchange For Burgers

An initiative in Stockholm is trying to keep streets clean while satisfying hunger

Culture Today

Google Is Using Virtual Paper Airplanes To Bring People Closer Together

The tech giant released an app that lets people throw their good wishes out into the world on the International Day of Peace


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed Today

Why Building Better Offices Is The Key To Employee Engagement

Interaction Designer and Audio-visual Technologist at ESI Design illustrates the value in creating environments filled with surprise and delight

PSFK Labs september 22, 2016

The Future Of Work: Why Innovation Is Every Employee’s Job

PSFK Labs sits down with management at Johnson & Johnson to learn how the company comes up with their next ‘big idea’

Advertising Today

Get Paid For Traveling In San Francisco After Rush Hour

BART Perks rewards commuters who take early or late trains by giving them extra points to trade for money

Culture Today

Artist Designs Covers For Books That Don’t Exist

Published by the fictional 'Specious Books,' the subversive works facilitate a conversation regarding the artistic integrity of graphic designers

Work Today

Editorial Roundtable: The Arrival Of The People-First Workplace

Managed By Q, Soma, Workbar, Primary, AltSchool and thinkPARALLAX enumerate the reasons why companies need an employee-embracing workforce in order to exist

Food Today

Bringing Food Innovation To America’s Crowded Milk Market

a2 Milk's Blake Waltrip, Chief Executive of the USA region, discusses how the distributor plans on bringing the popular drink for the dairy-sensitive to the States


Future Of Work
Cultivating The Next Generation Of Leaders

Augmented / Virtual Reality Today

NBC Is Planning To Stream The Presidential Debates In Virtual Reality

Partnering with AltspaceVR, the broadcaster offers another way for Americans to engage with the election season

Travel Today

What Happens When An Entire Airport Terminal Rebrands Itself?

JFK's Terminal 4 underwent a dramatic design facelift to guide and delight travelers

Home september 23, 2016

Watch This Fire Pit Dance Along To Your Favorite Song

Music City Fire is a system that is designed to flicker in time to ambient music

No search results found.