Tracking and Retexturing Cloth for Real-Time Virtual Clothing Applications

In this paper, we describe a dynamic texture overlay method from monocular images for real-time visualization of garments in a virtual mirror environment. Similar to looking into a mirror when trying on clothes, we create the same impression but for virtually textured garments. The mirror is replaced by a large display that shows the mirrored image of a camera capturing e.g. the upper body part of a person. By estimating the elastic deformations of the cloth from a single camera in the 2D image plane and recovering the illumination of the textured surface of a shirt in real time, an arbitrary virtual texture can be realistically augmented onto the moving garment such that the person seems to wear the virtual clothing. The result is a combination of the real video and the new augmented model yielding a realistic impression of the virtual piece of cloth. Key words: Cloth Tracking and Augmentation, Augmented Reality, Virtual Clothing

• Type: Conference
• Year: 2009
• Where: MIRAGE
• Authors: Anna Hilsmann, Peter Eisert
• Keywords: Computer Vision, MIRAGE 2009, Virtual, Virtual Clothing, Virtual Mirror Environment