Step towards Sequence-to-Sequence Alignment

This paper presents an approach for establishing correspondencesin time and in space between two differentvideo sequences of the same dynamic scene, recorded by stationary uncalibrated video cameras. The method simultaneously estimates both spatial alignment as well as temporal synchronization (temporal alignment) between the two sequences, using all available spatio-temporal information. Temporal variations between image frames (such as moving objects or changes in scene illumination) are powerful cues for alignment, which cannot be exploited by standard image-to-image alignment techniques. We show that by folding spatial and temporal cues into a single alignment framework, situations which are inherently ambiguous for traditional image-to-image alignment methods, are often uniquely resolved by sequence-to-sequence alignment. We also present a “direct” method for sequence-tosequence alignment. The algorithm simultaneously estimates spatial and temporal alignment parameters direct...

• Type: Conference
• Year: 2000
• Where: CVPR
• Authors: Yaron Caspi, Michal Irani
• Keywords: CVPR 2000, Image-to-image Alignment, Spatial Alignment, Temporal Alignment