MIT researchers have created a new algorithm that matches sound effects to video

In Hollywood, the foley artist creates sound effects for the movies to replace or enhance the actual sounds captured during filming. Sometimes this means giant explosions, but more often it’s the sounds of everyday life: footsteps, the rubbing of clothes against each other, the opening and closing of doors, and so on. The foley artist considers their work a success if no one notices it, and by that measure, MIT has created an artificial intelligence that does successful foley work. Researchers at the Computer Science and Artificial Intelligence Laboratory (CSAIL) developed a machine-learning algorithm that can predict sounds to accompany a silent video clip.

This content is available for Basic Members.
Already a member, log in