Rate-distortion analysis of rectification-based view interpolation for multiview video coding

View interpolation has been applied in multiview view coding. However, existing schemes assume all cameras are aligned. These methods may not perform well when neighboring cameras point to different directions. In this paper, we apply the rectification based view interpolation to MVC. We first derive the theoretical performance gain of the rectification based view interpolation over existing interpolation method. We then analyze the rate-distortion performance of the proposed MVC method, and compare with the disparity compensation based MVC and view interpolation based MVC without rectification. The analyses show that view rectification can offer additional coding gain over existing view interpolation based MVC, especially when the disparity estimation is accurate and when the neighboring cameras are close to each others. Preliminary experimental results are provided to verify the theoretical analysis.

• Type: Journal
• Year: 2009
• Where: ICMCS
• Authors: Xiaoyu Xiu, Jie Liang
• Keywords: ICMCS 2009, Multimedia, Neighboring Cameras, Rectification Based View, View Interpolation