Robust real-time tracking by fusing measurements from inertial and vision sensors

Abstract The problem of estimating and predicting position and orientation (pose) of a camera is approached by fusing measurements from inertial sensors (accelerometers and rate gyroscopes) and vision. The sensor fusion approach described in this contribution is based on non-linear filtering of these complementary sensors. This way, accurate and robust pose estimates are available for the primary purpose of augmented reality applications, but with the secondary effect of reducing computation time and improving the performance in vision processing. A real-time implementation of a multi-rate extended Kalman filter is described, using a dynamic model with 22 states, where 100 Hz inertial measurements and 12.5 Hz correspondences from vision are processed. An example where an industrial robot is used to move the sensor unit is presented. The advantage with this configuration is that it provides ground truth for the pose, allowing for objective performance evaluation. The results show th...

• Type: Journal
• Year: 2007
• Where: JRTIP
• Authors: Jeroen D. Hol, Thomas B. Schön, Henk Luinge, Per J. Slycke, Fredrik Gustafsson
• Keywords: Hz Inertial Measurements, JRTIP 2007, Robust Pose Estimates, Sensor