How Sesame Street Is Re-imagining A Show’s Storyline For Kinect-Era Television [PSFK LONDON]

How Sesame Street Is Re-imagining A Show’s Storyline For Kinect-Era Television [PSFK LONDON]

The Creative Director of the Content Innovation Lab at Sesame Workshop talks to PSFK about the future of educational programming centered on interactivity.

Timothy Ryan, PSFK Labs
  • 8 september 2012

We are excited to have J Milligan, Creative Director of the Content Innovation Lab for Sesame Workshop, come speak at PSFK CONFERENCE LONDON. Sesame Workshop has recently partnered with Microsoft to leverage the Kinect for enhanced educational programming centered on interactivity. On September 13th, Jason will discuss reimagining a show’s storyline for Kinect-era television.

Sesame Workshop has been experimenting with digital learning materials for some time. What are the challenges around designing interactive programming for kids?

If you’re interested in teaching literacy, numeracy, rhymes or anything else, you will always be fighting the platform. The first set of instructions is always about moving the cursor around, picking up the mouse, or just trying to deal with basic interface issues before we can even teach anything.

The first thing we always have to teach is how to use the platform, but that’s been falling away more and more lately. First, going to touch, which is such an intuitive thing for kids. Many children can already navigate an iPhone at a very young age. Touch is intuitive, and Kinect is even better because it’s just about moving your body and using your voice to make things happen on screen.

I’ve been designing digital curricula for a while and it has always been a challenge to design for an age group appropriately. Whenever you hear people talk about design, they talk about designing for the extreme user; if you design for the extreme instead of the middle, the logic goes, everything will work itself out. Designing for preschoolers is definitely one end of the extreme.

Recently you’ve partnered with Microsoft to develop programming leveraging the Kinect platform. What is the opportunity?

When Kinect came along we had a viable platform available at scale that millions of people already had in their homes. Bringing video to the platform and making it react to the player and what they’re actually doing finally brought together some of our thinking around creating engaging educational material in a significant and incredibly interesting way.

Sesame Workshop had always been interested in using television as a tool to teach. If a platform can react to a viewer or player in a meaningful way, it makes an experience that much more personal. We’d been looking at ways to do this for a long time: back in the 1980s we did a project with Viewmaster using VHS to build an interactive TV experience, which is kind of incredible. We did a big workshop with AFI in 2002 to use a DVD platform to create an interactive experience, and we also did some work with CableVision using the remote. At that time, a lot of people who were working the space were doing what I call ‘science experiments;’ you could make interactive TV, but you had to build your own hardware and software to make anything happen.

What specifically with respect to the Kinect is so engaging and intuitive for Sesame Workshop’s audience?

Sesame is all about making the whole thing fun and entertaining, and ‘engagement’ is exactly the right way to describe it. The more you’re engaged in the content, the more you’ll get out of the learning materials we’re presenting. For example, in the case of the Kinect-enabled game Letter Tree, what we’re really teaching you is that ‘A’ is the first letter sound. All we’re asking you to do is jump, and that’s something kids are very willing to do.

We’re focused on embedding interactivity into the narratives we’re creating, where the things we’re asking the kid to do just feel natural and organic. Now we’re able to bring that experience in to your living room. When Elmo throws you a ball through the glass of the TV, you throw it back to him and he catches it. When Cookie Monster says, “I need your help, there’s something stuck in this tree that I want to eat, jump to shake this tree,” the viewer will start jumping. It’s just incredibly natural for a kid to make a throwing motion or start jumping. We’ve seen this in testing, and I’ve seen this in my own home – it’s great.

When it comes to Kinect, I would definitely say we’re still figuring it out, but currently we have eight shows coming out; eight episodes coming out around the time of the conference and then another eight on Christmas day.

Have the goals of Sesame Workshop changed at all over the years?

Our mission is to reach kids on every available platform, and give them developmentally-appropriate, educational content to get them ready for school and life. Sesame Workshop, as you may know, is going into our 43rd season of production this fall. It was a show that Joan Ganz Cooney and Lloyd Morisett invented in the late ’60s (with help from Jim Henson and the Muppets) to harness the power of television to get kids excited and prepared for school.

What is your role in creating those platforms?

I’m the creative director of the Content Innovation Lab, a small group of six people who look three to five years out to determine what platforms are going to be relevant and what Sesame should be working on. We build capacity for the company as a whole on things like gesture and voice and my role has always been on the digital side. I’ve been designing interactive experiences for (mostly) preschool kids for almost 17 years.  I’ve designed on every major platform to come along since the mid-1990s: things like PC CD‑ROM to web, consoles like PS1, handheld, Gameboy and then lately moving to mobile apps, touch‑screen iPad, iPod, iPhone and now Kinect. Back in the day, Sesame Workshop was doing software for things like the Apple II, and so the digital side of things goes back almost as far as the television show. Now we’re bringing it all together. The project that I’m bringing to the PSFK London Conference, “Connect Sesame Street,” is basically interactive TV on the Xbox console.

Thanks Jason!

Jason Milligan/ @jmilligan718/ Sesame Workshop

Come see Jason discuss re-imagining a show’s storyline for Kinect-era television at PSFK CONFERENCE LONDON on September 13th.


Japanese Face Wash Creates A Perfect Rose Every Time

Arts & Culture
Mobile Yesterday

Get A Better Idea Of How You Are Wasting Your Time

The TouchTime app is trying to revolutionize personal task management by providing detailed insight on how to be more efficient

Culture Yesterday

London Telephone Box Repurposed As A Tiny Mobile Repair Shop

Tools and supplies to replace broken screens or damage are neatly stowed away in these micro-workrooms


Get PSFK's Latest Report: Future of Work

See All
Design Yesterday

Conceptual Sportswear Created Out Of Futuristic Condom Material

A Dutch fashion designer is experimenting with new methods and fabrics to make high performance clothing

Fashion Yesterday

Fashionable Tassel Will Ensure You Never Lose Your Valuables Again

The device is fashion meets connected tech, that will help you keep track of your belongings at all times


Jonathan Ford

Brand, Product & Experience Design

Syndicated Yesterday

Would You Wear Wool Shoes To Save The Environment?

As demand for wool shoes grows, a number of US footwear brands are heading directly to the source: the sheep pastures of New Zealand

Sustainability Yesterday

Self-Healing Material Is Fashioned Out Of Squid Teeth

Penn State researchers have devised a new textile that uses organic proteins

Arts & Culture Yesterday

Search Engine Turns Your Own Drawings Into Photos

This image-matching software accepts hand-made sketches instead of keywords


Future Of Work
Cultivating The Next Generation Of Leaders

PSFK Op-Ed august 23, 2016

Modern Workplace Culture: No More Fat Cats Or Kissing Ass

Samar Birwadker, CEO & Co-Founder of Good & Co, on designing shared organizational values to optimize employee happiness and success

PSFK Labs august 25, 2016

PSFK’s Workplace Vision: How The Nurturing Of Seeds Will Come To Define The Onboarding Process

Our Future of Work vision is a service that allows companies to assemble and deliver welcome packets that are uniquely focused on the concept of growth

Arts & Culture Yesterday

Illustrator Interprets The Experiences Of Blind Travelers

Artist Alby Letoy creates drawings of poignant travel memories for the visually impaired

Advertising Yesterday

Clickbait Titles Used For The Good Of Charity

An agency devised an unlikely campaign that uses clickbait as a positive force to drive awareness to nonprofit initiatives

Advertising Yesterday

The Best In Eye-Catching Olympics Campaigns

PSFK rounds out the Rio Games with our picks for the best advertising moments off the field

Work Yesterday

Editorial Roundtable: The Arrival Of The People-First Workplace

Managed By Q, Soma, Workbar, Primary and thinkPARALLAX enumerate the reasons why companies need an employee-embracing workforce in order to exist

Arts & Culture Yesterday

Transforming Light Waves Into A New Art Form

An artist uses glass treated with layers of metallic coatings to create a unique installation called lightpaintings


Rio Olympics
Innovation Coverage From The Rio Games

Design Yesterday

This Windbreaker Lets You Explore The Outdoors While Charging Your Phone

The apparel includes solar panels that allow the wearer to stay connected through the power of renewable energy

Asia Yesterday

The Goal Of This Game Is To Not Get Laid Off From Your Job

A hit mobile app has you working really, really hard to not get fired as you climb the corporate ladder

Advertising Yesterday

Movie Critic Bot Guides Viewers Through Festival Offerings

The Toronto International Film Festival has created a Facebook Messenger chatbot to help attendants curate their schedule

No search results found.