Online Video Registration of Dynamic Scenes Using Frame Prediction

An online approach is proposed for Video registration of dynamic scenes, such as scenes with dynamic textures, moving objects, motion parallax, etc. This approach has three steps: (i) Assume that a few frames are already registered. (ii) Using the registered frames, the next frame is predicted. (iii) A new video frame is registered to the predicted frame. Frame prediction overcomes the bias introduced by dynamics in the scene, even when dynamic objects cover the majority of the image. It can also overcome many systematic changes in intensity, and the "brightness constancy" is replaced with "dynamic constancy". This predictive online approach can also be used with motion parallax, where non uniform image motion is caused by camera translation in a 3D scene with large depth variations. In this case a method to compute the camera ego motion is described. Unlike video synthesis methods that generate dynamic video for display purposes, predictive alignment and registrat...

• Type: Conference
• Year: 2006
• Where: ECCV
• Authors: Alex Rav-Acha, Yael Pritch, Shmuel Peleg
• Keywords: Computer Vision, Dynamic Scenes, ECCV 2006, Motion Parallax, Online Approach