High resolution passive facial performance capture

We introduce a purely passive facial capture approach that uses only an array of video cameras, but requires no template facial geometry, no special makeup or markers, and no active lighting. We obtain initial geometry using multi-view stereo, and then use a novel approach for automatically tracking texture detail across the frames. As a result, we obtain a high-resolution sequence of compatibly triangulated and parameterized meshes. The resulting sequence can be rendered with dynamically captured textures, while also consistently applying texture changes such as virtual makeup. CR Categories: I.3.3 [COMPUTER GRAPHICS]: Picture/Image Generation—Digitizing and scanning; I.3.5 [COMPUTER GRAPHICS]: Computational Geometry and Object Modeling—Geometric algorithms, languages, and systems.

• Type: Conference
• Year: 2010
• Where: SIGGRAPH
• Authors: Derek Bradley, Wolfgang Heidrich, Tiberiu Popa, Alla Sheffer
• Keywords: Computer Graphics, Passive Facial Capture, SIGGRAPH 2010, Template Facial Geometry