Efficient multi-view object recognition and full pose estimation

We present an approach for efficiently recognizing all objects in a scene and estimating their full pose from multiple views. Our approach builds upon a state of the art single-view algorithm which recognizes and registers learned metric 3D models using local descriptors. We extend to multiple views using a novel multi-step optimization that processes each view individually and feeds consistent hypotheses back to the algorithm for global refinement. We demonstrate that our method produces results comparable to the theoretical optimum, a full multi-view generalized camera approach, while avoiding its combinatorial time complexity. We provide experimental results demonstrating pose accuracy, speed, and robustness to model error using a three-camera rig, as well as a physical implementation of the pose output being used by an autonomous robot executing grasps in highly cluttered scenes.

• Type: Journal
• Year: 2010
• Where: ICRA
• Authors: Alvaro Collet, Siddhartha S. Srinivasa
• Keywords: Combinatorial Time Complexity, ICRA 2010, Metric 3D Models, Multi-view Generalized Camera, Robotics