3-D Reconstruction from Sparse Views using Monocular Vision

We consider the task of creating a 3-d model of a large novel environment, given only a small number of images of the scene. This is a difficult problem, because if the images are taken from very different viewpoints or if they contain similar-looking structures, then most geometric reconstruction methods will have great difficulty finding good correspondences. Further, the reconstructions given by most algorithms include only points in 3-d that were observed in two or more images; a point observed only in a single image would not be reconstructed. In this paper, we show how monocular image cues can be combined with triangulation cues to build a photo-realistic model of a scene given only a few images--even ones taken from very different viewpoints or with little overlap. Our approach begins by oversegmenting each image into small patches (superpixels). It then simultaneously tries to infer the 3-d position and orientation of every superpixel in every image. This is done using a Marko...

• Type: Conference
• Year: 2007
• Where: ICCV
• Authors: Ashutosh Saxena, Min Sun, Andrew Y. Ng
• Keywords: 3-d Model, Computer Vision, ICCV 2007, Monocular Cues, Monocular Image Cues, Single Image, Triangulation Cues