Using Space-Time Interest Points for Video Sequence Synchronization

We introduce an algorithm for synchronizing two video sequences recorded by stationary cameras. It extends common RANSAC-based approaches that recover either a homography or a fundamental matrix from putatively matched spatial features in two images. In our algorithm, we detect space-time interest points in each sequence which represent events such as objects changing direction, and putatively matching points from each sequence are determined. A nested RANSAC framework on these putative matches is then used to firstly recover the frame offset and ratio of frame rates of the two sequences, then either a homography or a fundamental matrix relating the two views, depending on the type of motion contained within the sequences. No camera calibration or object tracking is required. Real sequences containing motion either on a plane or in free space are synchronized and it is demonstrated that this approach is successful in recovering the ratio of frame rates, the frame offset, and the homog...

• Type: Conference
• Year: 2007
• Where: MVA
• Authors: Daniel Wedge, Du Huynh, Peter Kovesi
• Keywords: Computer Vision, Frame Rates, Fundamental Matrix, MVA 2007, Sequences