Segmentation-Based Postprocessing in Real-Time Immersive Video Conferencing

We present a novel, real-time disparity analysis frame work developed for immersive teleconferencing. This two-stage method computes a limited number of highly reliable disparities in the first step and then, filling the remaining holes based on segmentation information. The disparity algorithm is a hybrid recursive matching (HRM) approach. Its computational effort is minimised by the efficient selection of a small number of candidate vectors, guaranteeing both spatial and temporal consistency of disparities. In order to improve the disparity fields in the case of occlusions, a segmentation-based postprocessing is applied. The teleconferencing application requires video processing at ITU-Rec. 601 resolution. In the current version, the algorithm generates disparity maps in real time for both directions (Left Right and Right Left) on a Pentium III, 800 MHz processor.

• Type: Conference
• Year: 2001
• Where: VMV
• Authors: Oliver Schreer, Serap Askar, Nicole Brandenburg, Peter Kauff
• Keywords: Algorithm Generates Disparity, Disparity Algorithm, Disparity Analysis Frame, VMV 2001, VMV 2008