Video-based Characters-Creating New Human Performances from a Multi-view Video Database

We present a method to synthesize plausible video sequences of humans according to user-defined body motions and viewpoints.We first capture a small database of multi-view video sequences of an actor performing various basic motions and then apply a marker-less model-based performance capture approach to the entire database to obtain pose and geometry of the actor in each database frame.To create novel video sequences of the actor from the database,a user animates a 3D human skeleton with novel motion and viewpoints.Our technique then synthesizes a realistic video sequence of the actor performing the specified motion based only on the initial database.