Basis constrained 3D scene flow on a dynamic proxy

Existing scene flow approaches mainly focus on twoframe stereo-pair configurations and reconstruct an imagebased representation of scene flow. Instead, we propose a variational formulation of scene flow relative to a coarse proxy geometry, which is better suited for many views. Furthermore, a linear basis is used to represent temporal surface flow, allowing for longer-range temporal correspondence with fewer variables. Our formulation takes known proxy motion into account (e.g, if the proxy is a tracked human subject), which enables 3D trajectory reconstruction when only a single view is available. Additionally, through the appropriate proxy and basis, our framework generalizes existing approaches for scene flow, optic-flow, and twoframe stereo. We illustrate results on real-data for both static and moving proxy surfaces over several frames.

• Type: Journal
• Year: 2011
• Where: ICCV
• Authors: Neil Birkbeck, Martin Jagersand, Dana Cobzas
• Keywords: Computer Vision, Human Subject, ICCV 2011, Stereo Pair, Variational Formulation