Space-Time Completion of Video

—This paper presents a new framework for the completion of missing information based on local structures. It poses the task of completion as a global optimization problem with a well-defined objective function and derives a new algorithm to optimize it. Missing values are constrained to form coherent structures with respect to reference examples. We apply this method to space-time completion of large space-time “holes” in video sequences of complex dynamic scenes. The missing portions are filled in by sampling spatiotemporal patches from the available parts of the video, while enforcing global spatio-temporal consistency between all patches in and around the hole. The consistent completion of static scene parts simultaneously with dynamic behaviors leads to realistic looking video sequences and images. Space-time video completion is useful for a variety of tasks, including, but not limited to: 1) Sophisticated video removal (of undesired static or dynamic objects) by completing t...

• Type: Journal
• Year: 2007
• Where: PAMI
• Authors: Yonatan Wexler, Eli Shechtman, Michal Irani
• Keywords: PAMI 2007, Space-time Video Completion, Video, Video Sequences