Multi-Frame Optical Flow Estimation using Subspace Constraints

We show that the set of all ow- elds in a sequence of frames imaging a rigid scene resides in a lowdimensional linear subspace. Based on this observation, we develop a method for simultaneous estimation of optical- ow across multiple frames, which uses these subspace constraints. The multi-frame subspace constraints are strong constraints, and replace commonly used heuristic constraints, such as spatial or temporal smoothness. The subspace constraints are geometrically meaningful, and are not violated at depth discontinuities, or when the camera-motionchanges abruptly. Furthermore, we show that the subspace constraints on ow- elds apply for a variety of imaging models, scene models, and motion models. Hence, the presented approach for constrained multi-frame ow estimation is general. However, our approach does not require prior knowledge of the underlying world or camera model. Although linear subspace constraintshavebeen used successfully in the past for recovering 3D information (e....

• Type: Conference
• Year: 1999
• Where: ICCV
• Authors: Michal Irani
• Keywords: Computer Vision, ICCV 1999, Linear Subspace, Multi-frame Subspace Constraints, Subspace Constraints