Virtual view synthesis is essential for 3D teleconference systems like VIRTUE, which utilizes the motion parallax cue. In this paper we propose a multi-step view synthesis algorithm to efficiently reconstruct an arbitrary view in real time and utilize all the information we have from stereo cameras. We show that the newly proposed algorithm can be used to reconstruct a high quality view from an arbitrary pose, using occlusion information. Its modular property makes real-time implementation feasible and due to the parallel setup latency can be kept low.
Bang Jun Lei, Emile A. Hendriks