Model-Based Bundle Adjustment with Application to Face Modeling

We present a new model-based bundle adjustment algorithm to recover the 3D model of a scene/object from a sequence of images with unknown motions. Instead of representing scene/object by a collection of isolated 3D features (usually points), our algorithm uses a surface controlled by a small set of parameters. Compared with previous modelbased approaches, our approach has the following advantages. First, instead of using the model space as a regularizer, we directly use it as our search space, thus resulting in a more elegant formulation with fewer unknowns and fewer equations. Second, our algorithm automatically associates tracked points with their correct locations on the surfaces, thereby eliminating the need for a prior 2D-to-3D association. Third, regarding face modeling, we use a very small set of face metrics (meaningful deformations) to parameterize the face geometry, resulting in a smaller search space and a better posed system. Experiments with both synthetic and real data s...

• Type: Conference
• Year: 2001
• Where: ICCV
• Authors: Ying Shan, Zicheng Liu, Zhengyou Zhang
• Keywords: Better Posed System, Bundle Adjustment Algorithm, Computer Vision, Fewer Unknowns, ICCV 2001, Isolated 3D Features, Smaller Search Space