Detecting Motion Regions in the Presence of a Strong Parallax from a Moving Camera by Multiview Geometric Constraints

—We present a method for detecting motion regions in video sequences observed by a moving camera in the presence of a strong parallax due to static 3D structures. The proposed method classifies each image pixel into planar background, parallax, or motion regions by sequentially applying 2D planar homographies, the epipolar constraint, and a novel geometric constraint called the “structure consistency constraint.” The structure consistency constraint, being the main contribution of this paper, is derived from the relative camera poses in three consecutive frames and is implemented within the “Plane þ Parallax” framework. Unlike previous planar-parallax constraints proposed in the literature, the structure consistency constraint does not require the reference plane to be constant across multiple views. It directly measures the inconsistency between the projective structures from the same point under camera motion and reference plane change. The structure consistency constraint...

• Type: Journal
• Year: 2007
• Where: PAMI
• Authors: Chang Yuan, Gérard G. Medioni, Jinman Kang, Isaac Cohen
• Keywords: Epipolar Constraint, Motion Regions, PAMI 2007, Structure Consistency Constraint