Super-resolution of video using key frames and motion estimation

Many scalable video coding systems use frame downsampling in order to reduce complexity and to enable enhancement layers. Super-resolution (SR) can be used to help the up-sampling and recovering processes of those frames. We are interested in reversed-complexity (distributed) coding methods, wherein few key frames are encoded at normal resolution, while the rest are downsampled and encoded at reduced resolution along with the enhancement layers. We are only interested on the decoder side, wherein we carry motion estimation of the downsampled frames using the key frames as references. When a match is made, the high-frequency components of the key frames (KF) are used to super-resolve the non-key frames (NKF). The motion estimation process is performed using blocks of band-pass versions of the frames, rather than lowpass ones. Results indicate the improved performance of the proposed super-resolution algorithm.

• Type: Conference
• Year: 2008
• Where: ICIP
• Authors: Fernanda Brandi, Ricardo L. de Queiroz, Debargha Mukherjee
• Keywords: Downsampled Frames, Enhancement Layers, ICIP 2008, Image Processing, Key Frames, Motion Estimation Process, Non-key Frames