High Resolution Tracking of Non-Rigid 3D Motion of Densely Sampled Data Using Harmonic Maps

We present a novel fully automatic method for high resolution, non-rigid dense 3D point tracking. High quality dense point clouds of non-rigid geometry moving at video speeds are acquired using a phase-shifting structured light ranging technique. To use such data for the temporal study of subtle motions such as those seen in facial expressions, an efficient non-rigid 3D motion tracking algorithm is needed to establish inter-frame correspondences. The novelty of this paper is the development of an algorithmic framework for 3D tracking that unifies tracking of intensity and geometric features, using harmonic maps with added feature correspondence constraints. While the previous uses of harmonic maps provided only global alignment, the pro

• Type: Conference
• Year: 2005
• Where: ICCV
• Authors: Yang Wang, Mohit Gupta, Song Zhang 0002, Sen Wang, Xianfeng Gu, Dimitris Samaras, Peisen Huang
• Keywords: Computer Vision, Harmonic Maps, ICCV 2005, Non-rigid 3D Motion, Non-rigid Dense