An Immersive Free-Viewpoint Video System Using Multiple Outer/Inner Cameras

We propose a new free-view video system that generates immersive 3D video from arbitrary point of view, using outer cameras and an inner omni-directional camera. The system reconstructs 3D modes from the captured video streams and generates realistic free-view video of those objects from a virtual camera. In this paper, we propose a real-time omni-directional camera calibration method, and describe a shape-from-silhouette technique for 3D modeling and a micro-facet billboarding technique for rendering. Owing to the movability and high resolution of the inner omni-directional camera, the proposed system reconstructs more elaborate 3D models and generates natural and vivid video with an immersive sensation.

• Type: Conference
• Year: 2006
• Where: 3DPVT
• Authors: Hansung Kim, Itaru Kitahara, Ryuuki Sakamoto, Kiyoshi Kogure
• Keywords: 3DPVT 2006, Applied Computing, Immersive 3D Video, Inner Omni-directional Camera, Omni-directional Camera Calibration