VideoMocap: modeling physically realistic human motion from monocular video sequences

This paper presents a video-based motion modeling technique for generating physically realistic human motion from monocular video sequences. We formulate the video-based motion modeling process in an image-based keyframe animation framework. The system first computes camera parameters, human skeletal size, and a small number of 3D key poses from video and then uses 2D image measurements at intermediate frames to automatically calculate the “in between” poses. During reconstruction, we leverage Newtonian physics, contact constraints, and 2D image measurements to simultaneously reconstruct full-body poses, joint torques, and contact forces. We have demonstrated the power and effectiveness of our system by generating a wide variety of physically realistic human actions from uncalibrated monocular video sequences such as sports video footage. CR Categories: I.3.6 [Computer Graphics]: Methodology and Techniques—interaction techniques; I.3.7 [Computer Graphics]: Three-Dimensional Gra...

• Type: Conference
• Year: 2010
• Where: SIGGRAPH
• Authors: Xiaolin Wei, Jinxiang Chai
• Keywords: Computer Graphics, Monocular Video Sequences, Realistic Human Motion, SIGGRAPH 2010, Video-based Motion Modeling