Appearance Compression and Synthesis based on 3D Model for Mixed Reality

Rendering photorealistic virtual objects from their real images is one of the main research issues in mixed reality systems. We previously proposed the Eigen-Texture method, a new rendering method for generating virtual images of objects from thier real images to deal with the problems posed by past work in image-based methods and modelbased methods. Eigen-Texture method samples apperances of a real object under various illumination and viewing conditions, and compresses them in the 2D coordinate system defined on the 3D model surface. However, we had a serious limitation in our system, due to the alignment problem of the 3D model and color images. In this paper we deal with this limitation by solving the alignment problem; we do this by using the method orginally designed by Viola[14]. This paper describes the method, and reports on how we implement it.

• Type: Conference
• Year: 1999
• Where: ICCV
• Authors: Ko Nishino, Yoichi Sato, Katsushi Ikeuchi
• Keywords: Alignment Problem, Computer Vision, Eigen-Texture Method, ICCV 1999, Method Samples Apperances, Photorealistic Virtual Objects, Thier Real Images