Webcam Detects Behaviors That Signal Autism

Webcam Detects Behaviors That Signal Autism

By tracking the body movements of toddlers, this new system could lead to earlier intervention in autistic children.

John Pugh, BI
  • 18 november 2012

There are a lot of myths and misunderstandings about autism. Simply put, it is a physical disorder associated with brain biology and chemistry that impairs an individual’s social and communications skills. The exact cause is unknown, but it is generally believed that genetic factors play a large role.

Early diagnosis is extremely important. As there is no ‘cure,’ treatments are behavioral and run over the course of years. Starting therapy early is a huge benefit to the patient’s quality of life. That said, it is a difficult and expensive process to evaluate a toddler for autism, one that requires expert monitoring over a long period of time. But what if that could be automated?

That’s where Jordan Hashemi and his team at the University of Minnesota come in. Using video footage of at-risk toddler behavior, which families can record at home or at a clinic, they have developed a computer vision system that analyses the movements of children as young as two years old and identifies behaviors linked with autism.

By tracking position and movement of the child’s head, torso, arms and legs, the program can recognize the restricted, repetitive behaviors that are indicative of autism. For example, autistic children tend to walk on their toes, hold their limbs in asymmetrical positions while moving, and show delays in tracking objects in their field of vision.

Hashemi’s system looks for these behaviors automatically and has performed well in tests. The research team videoed 15 children who were identified as at risk for autism and showed the footage to a specialist in child autism, a child psychiatrist, two psychology students and their system. Taking the specialist’s opinion as the standard, the computer system did better than both the psychiatrist and the students in that it agreed more often with the specialist’s assessment. Pretty impressive for a first generation technology.

Of course the system requires lots of additional testing. But that shouldn’t be too hard for Hashemi and his team; they can use archival footage of autistic children whose condition is already known to calibrate the system’s assessments. Once perfected, this technology could greatly reduce the time required to diagnose autism and other developmental disorders. Of course a human expert would need to review the conclusions, but the time saved in diagnosis would lead to earlier interventions and improved quality of life for patients.

In more common circumstances, a future system could monitor any young child who has missed developmental milestones. Because doctors can’t watch an infant for significant periods of time and parents might not be able to expertly judge their baby’s behavior, a pediatrician might recommend that a baby with ‘red flag’ behavior (like not smiling or reacting to a parent’s face at three months) have a webcam installed on their crib. This would send video to a center with an advanced version of Hashemi’s system that would monitor and compare the baby’s behavior with normal developmental benchmarks. The parents could interact with this monitoring as well, moving objects across the baby’s field of vision to see if it can track them or if it reacts to human speech with excited gestures, as babies of a certain age should.

There would be privacy issues involved, but when the early intervention of developmentally delayed children can prevent lifelong struggles and bring them ‘up to speed’ with their peers, the potential benefits would likely outweigh any of the associated stigmas.

Computer vision tools for the non-invasive assessment of autism-related behavioral markers (PDF)

PSFK has partnered with Boehringer Ingelheim to bring you a steady stream of inspiring news and ideas in the health and wellness space. Once each week, we will be posting an article on If you would like to gain access to the full stream of content, please check out Boehringer Ingelheim’s Facebook page, where they are publishing a regular stream of inspiring and informative content.


Fitness Advocate: Paving The Future of Workouts With Audio

Fitness & Sport
Travel Today

Bus Stop Transformed Into A Fitness Station For Commuters

Sports drink company Lucozade live-streamed an athletic trainer working out at a stop in Manchester to encourage travelers to get moving

Technology Today

Shiseido And Microsoft Have Created A Makeup Filter For Women Who Telecommute

The Japanese cosmetic company built an augmented reality app that works alongside Skype for Business


Get PSFK's Related Report: Sports Debrief

See All
Mobile Today

Samsung Is Using AR To Help Beachgoers Stay Safe

Pocket Patrol utilizes a phone's camera to promote beach safety and educate people about hidden hazards

Related Expert

Barry Richards

Exhibition Design

Retail Today

Exchange Your Old Razors For New Ones At This Bartershop

The subscription-based shaving company lets customers trade their unwanted razors for Harry's brand steel at a temporary New York pop-up

Food Today

A Brewer Has Created The Most Expensive Chips To Snack On

St. Eriks Brewery created crisps made from rare mushrooms to go with its artisan beer, donating all proceeds to charity

Op-Ed Today

Marketing Experts: Millennials And The Power Of Cool

'Good Is The New Cool' Authors Afdhel Aziz and Bobby Jones share their 7 principles for branding with a social impact


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed october 21, 2016

Health Expert: Nutritional Meal Replacements Are A Solution To Corporate Wellness

Ample Foods Founder Connor Young explains why supplements are the next food trend coming to the workplace

PSFK Labs Today

The Keys For Exceptional Performance On And Off The Field

PSFK Labs' new report highlights five important insights for businesses to perform better than the competition

Travel Today

Melbourne Hotel Lets Guests Stay In Their Own Chrome Airstream Trailers

Notel is a luxury rooftop with six guest rooms made from vintage 1970s mobile homes

Infants Today

Battery Powered Cradle Will Rock Itself

NoomiNoomi is a clever device that makes it easier to put babies to sleep

Sustainability Today

Swedish Citizens Get A Tax Break For Repairing Old Goods

A sustainability initiative encourages people to fix, rather than replace, broken objects

Fitness & Sport Today

How Precision Data Can Make Anyone A Better Performer

The Sports Debrief from PSFK Labs looks at how analytic tools are being developed to optimize human performance across all industries

Home Today

You Can Now Buy Furniture From A Daytime TV Show

Home furnishing online retailer Wayfair is partnering with Lifetime to create a shoppable life improvement television program

Social Media Today

Instagram Tool Prevents People From Harming Themselves

A new anonymous reporting option on the social media platform hopes to provide better emotional support for users

Retail Today

Apple’s New London Store Is Filled With Living Trees And Sunlight

The brand's UK flagship location has been reimagined with a focus on customer experience and community

Syndicated Today

Artificial Intelligence Could Serve As A Judge In The Court Of The Future

A new software program can weigh up legal evidence and more questions of right and wrong to predict the outcome of trials

No search results found.