Automatic non-rigid registration of 3D dynamic data for facial expression synthesis and transfer

Automatic non-rigid registration of 3D time-varying data is fundamental in many vision and graphics applications such as facial expression analysis, synthesis, and recognition. Despite many research advances in recent years, it still remains to be technically challenging, especially for 3D dynamic, densely-sampled facial data with a large number of degrees of freedom (necessarily used to represent rich and subtle facial expressions). In this paper, we present a new method for automatic non-rigid registration of 3D dynamic facial data using least-squares conformal maps, and based on this registration method, we also develop a new framework of facial expression synthesis and transfer. Nowadays more and more 3D dynamic, densely-sampled data become prevalent with the advancement of novel 3D scanning techniques. To analyze and utilize such huge 3D data, an efficient non-rigid registration algorithm is needed to establish one-to-one inter-frame correspondences. Towards this goal, a non-rigi...

• Type: Conference
• Year: 2008
• Where: CVPR
• Authors: Sen Wang, Xianfeng David Gu, Hong Qin
• Keywords: Automatic Non-rigid Registration, Computer Vision, CVPR 2008, Efficient Non-rigid Registration, Facial Expression Synthesis, Non-rigid Registration Algorithm, Non-rigid Registration Method