Video Based Motion Synthesis by Splicing and Morphing

Authors:
Mori, Greg
Berg, Alex
Efros, Alyosha
Eden, Ashley
Malik, Jitendra
Technical Report Identifier: CSD-04-1337
June 2004
CSD-04-1337.pdf
CSD-04-1337.ps

Abstract: In this paper we present a method for synthesizing videos of human motion by splicing together clips of input video. There are two main contributions in this work. The first is developing a method for "kinematically correct morphing" of images of human figure, which is used to splice together the clips in input video in a manner that produces smooth output sequences. The second contribution of this work is the application of activity recognition algorithms to our input data in order to automatically extract action labels, which allow us to control the synthesized video by issuing high-level action commands. We present results of synthetic sequences on two domains: ballet and tennis.