Enhancing Silhouette-Based Human Motion Capture with 3D Motion Fields

High-quality non-intrusive human motion capture is necessary for acquistion of model-based free-viewpoint video of human actors. Silhouette-based approaches have demonstrated that they are able to accurately recover a large range of human motion from multi-view video. However, they fail to make use of all available information, specifically that of texture information. This paper presents an algorithm that uses motion fields constructed from optical flow in multi-view video sequences. The use of motion fields augments the silhoutte-based method by incorporating texture-information into the tracking process. The algorithm is a key-component in a larger free-viewpoint video system of human actors. Our results demonstrate that our method accurately estimates pose parameters and allows for realistic texture generation in 3D video sequences.

• Type: Conference
• Year: 2003
• Where: PG
• Authors: Christian Theobalt, Joel Carranza, Marcus A. Magnor, Hans-Peter Seidel
• Keywords: Human Motion, Multi-view Video, Non-intrusive Human Motion, PG 2003