3D Performance Capture for Facial Animation

This paper describes how a photogrammetry based 3D capture system can be used as an input device for animation. The 3D Dynamic Capture System is used to capture the motion of a human face which is extracted from a sequence of 3D models captured at TV frame rate. Initially the positions of a set of landmarks on the face are extracted. These landmarks are then used to provide motion data in two different ways. First, a high level description of the movements are extracted, and these can be used as input to a procedural animation package (i.e. CreaToon). Second the landmarks can be used as registration points for a conformation process where the model to be animated is modified to match the captured model. This approach gives a new sequence of models which have the structure of the drawn model but the movement of the captured sequence.

• Type: Conference
• Year: 2004
• Where: 3DPVT
• Authors: Donald MacVicar, Stuart Ford, Ewan Borland, Robert Rixon, John W. Patterson, W. Paul Cockshott
• Keywords: 3DPVT 2004, Dynamic Capture System, Input Device, TV Frame Rate, Visualization