Improved novel view synthesis from depth image with large baseline

In this paper, a new algorithm is developed for recovering the large disocclusion regions in depth image based rendering (DIBR) systems on 3DTV. For the DIBR systems, undesirable artifacts occur in the disocclusion regions by using the conventional view synthesis techniques especially with large baseline. Three techniques are proposed to improve the view synthesis results. The first is the preprocessing of the depth image by using the bilateral filter, which helps to sharpen the discontinuous depth changes as well as to smooth the neighboring depth of similar color, thus restraining noises from appearing on the warped images. Secondly, on the warped image of a new viewpoint, we fill the disocclusion regions on the depth image with the background depth levels to preserve the depth structure. For the color image, we propose the depth-guided exemplar-based image inpainting that combines the structural strengths of the color gradient to preserve the image structure in the restored regions...

• Type: Conference
• Year: 2008
• Where: ICPR
• Authors: Chia-Ming Cheng, Jinn-Cherng Yang, Shang-Hong Lai, Shu-Jyuan Lin
• Keywords: Background Depth Levels, Computer Vision, Depth Image, Discontinuous Depth Changes, ICPR 2008