Deborah D. McAdams /
08.12.2014 03:29 PM
Disney Demos Automated Multicamera Editing
Algorithm determines center of attention and calculates cuts
VANCOUVER, B.C., CANADA—Disney Researchers have come up with a way to auto-edit together footage from multiple social cameras. The team created an algorithm that takes in multiple video feeds and outputs a “single video of user-specified length that cuts between the multiple feeds automatically,” according to their research paper.

Researchers Ido Arev, Hyun Soo Park, Yaser Sheikh, Jessica Hodgins and Ariel Shamir, said their algorithm uses “existing cinematic rules.”

By determining the center of attention of the cameras and, by default, their operators, the algorithm indicates where the cuts should go. The center of attention is key. It is derived from the orientation of each person involved in a group activity and the footage they capture. The aggregate of the resulting viewing angles is referred to as the “gaze concurrence” or “3D joint attention,” which produces a metric for the “spatial and temporal location of the important ‘content’ of the activity.”

This information is used to plot a path on a trellis graph to determine edit cuts while avoiding jump cuts and crossing the line of action. The algorithm is said to cut according to the action and automatically switches between levels of zoom.

“While this indicator does not describe a complex narrative flow as a human editor might…. It does provide the information needed to create a watchable cutoff the video that condenses the video footage [a] hundredfold or more while retaining the important action that occurred during the event,” they said.

Post New Comment
If you are already a member, or would like to receive email alerts as new comments are
made, please login or register.

Enter the code shown above:

(Note: If you cannot read the numbers in the above
image, reload the page to generate a new one.)

Posted by: Anonymous
Wed, 08-13-2014 08:10 PM Report Comment
It will be interesting to see if Disney uses this technology to eliminate news photographers.
Posted by: Anonymous
Fri, 08-15-2014 05:30 AM Report Comment
Many stations already have the on-air camera talent do their own camera work, but this is a step to eliminate even that by making very viewable news footage out of raw footage gathered from social media or witnesses on-scene.
Posted by: Anonymous
Wed, 08-20-2014 03:19 PM Report Comment
When they came for the chess masters, I didn't move. When they came for the Jeopardy champions, I never questioned it. They came for the checkout clerks at WalMart, and I paid no mind. When they drove out the cab and truck drivers, I sat in the back, silent. When they cut MY job, no one was left to see the effect.

Thursday 11:07 AM
The Best Deconstruction of a 4K Shoot You'll Ever Read
With higher resolutions and larger HD screens, wide shots using very wide lenses can be a problem because they allow viewers to see that infinity doesn’t quite resolve into perfect sharpness.

Featured Articles
Exhibitions & Events
Discover TV Technology