The SPS Algorithm: Patching Figural Continuity and Transparency by Split-Patch Search

This paper describes a novel algorithm for the efficient synthesis of high-quality virtual views from only two input images. The emphasis is on the recovery of continuity of objects boundaries (figural continuity) with faithful synthesis of transparency effects. The contribution of this paper is two-fold: i) the SplitPatch Search (SPS) technique is introduced for dense stereo which handles transparency effects by assigning multiple disparities to mixed pixels; ii) an efficient extension of exemplar-based image synthesis to the case of two-camera stereo is proposed. Furthermore, this paper presents an approximate but effective solution to the challenging problem of layer estimation and compositing in the case of small image patches. The effectiveness of the proposed technique is demonstrated on a number of stereo image pairs taken from twocamera video-conferencing setups, where the quality of the synthesized talking heads is of paramount importance. Moreover, the improvement in the qua...

• Type: Conference
• Year: 2004
• Where: CVPR
• Authors: Antonio Criminisi, Andrew Blake
• Keywords: Computer Vision, CVPR 2004, Efficient Synthesis, Exemplar-based Image Synthesis, Faithful Synthesis, Stereo Image Pairs, Transparency Effects