Garment Motion Capture Using Color-Coded Patterns

In this paper we present an image-based algorithm for surface reconstruction of moving garment from multiple calibrated video cameras. Using a color-coded cloth texture, we reliably match circular features between different camera views. As surface model we use an a priori known triangle mesh . By identifying the mesh vertices with texture elements we obtain a consistent parameterization of the surface over time without further processing. Missing data points resulting from self-shadowing are plausibly interpolated by minimizing a thin-plate functional. The deforming geometry can be used for different graphics applications, e.g. for realistic retexturing. We show results for real garments demonstrating the accuracy of the recovered flexible shape. Categories and Subject Descriptors (according to ACM CCS): I.4.1 [Image Processing and Computer Vision]: Digitization and Image Capture I.3.7 [Computer Graphics]: Animation

• Type: Journal
• Year: 2005
• Where: CGF
• Authors: Volker Scholz, Timo Stich, Michael Keckeisen, Markus Wacker, Marcus A. Magnor
• Keywords: CGF 2005, Color-coded Cloth Texture, Multiple Calibrated Video, Priori Known Triangle