Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data

We address the structure-from-motionproblem in the context of head modeling from video sequences for which calibration data is not available. This task is made challenging by the fact that correspondences are difficult to establish due to lack of texture and that a quasi-euclidean representation is required for realism. We have developed an approach based on regularized bundle-adjustment. It takes advantage of our rough knowledge of the head's shape, in the form of a generic face model. It allows us to recover relative head-motion and epipolar geometry accurately and consistently enough to exploit a previouslydeveloped stereo-based approach to head modeling. In this way, complete and realistic head models can be acquired with a cheap and entirely passive sensor, such as an ordinary video camera with minimal manual intervention. We chose to demonstrate and evaluate our technique mainly in the context of head-modeling. We do so because it is the application for which all the tools ...

• Type: Journal
• Year: 2000
• Where: IJCV
• Authors: Pascal Fua
• Keywords: Generic Face Model, IJCV 2000, Realistic Head Models, Video Sequences