Dense 3D motion capture from synchronized video streams

Abstract: This paper proposes a novel approach to nonrigid, markerless motion capture from synchronized video streams acquired by calibrated cameras. The instantaneous geometry of the observed scene is represented by a polyhedral mesh with fixed topology. The initial mesh is constructed in the first frame using the publicly available PMVS software for multi-view stereo [7]. Its deformation is captured by tracking its vertices over time, using two optimization processes at each frame: a local one using a rigid motion model in the neighborhood of each vertex, and a global one using a regularized nonrigid model for the whole mesh. Qualitative and quantitative experiments using seven real datasets show that our algorithm effectively handles complex nonrigid motions and severe occlusions.

• Type: Conference
• Year: 2008
• Where: CVPR
• Authors: Yasutaka Furukawa, Jean Ponce
• Keywords: Computer Vision, CVPR 2008, Initial Mesh, Markerless Motion Capture, Polyhedral Mesh, Regularized Nonrigid Model, Rigid Motion Model