Detailed Human Shape and Pose from Images

Much of the research on video-based human motion capture assumes the body shape is known a priori and is represented coarsely (e.g. using cylinders or superquadrics to model limbs). These body models stand in sharp contrast to the richly detailed 3D body models used by the graphics community. Here we propose a method for recovering such models directly from images. Specifically, we represent the body using a recently proposed triangulated mesh model called SCAPE which employs a low-dimensional, but detailed, parametric model of shape and pose-dependent deformationsthat is learned from a database of range scans of human bodies. Previous work showed that the parameters of the SCAPE model could be estimated from marker-based motion capture data. Here we go further to estimate the parameters directly from image data. We define a cost function between image observations and a hypothesized mesh and formulate the problem as optimization over the body shape and pose parameters using stochasti...

• Type: Conference
• Year: 2007
• Where: CVPR
• Authors: Alexandru O. Balan, Leonid Sigal, Michael J. Black, James E. Davis, Horst W. Haussecker
• Keywords: Body Models, Body Shape, Computer Vision, CVPR 2007, Detailed 3d Body, Detailed Human Shape, Model Called Scape