Vision-Inertial Hybrid Tracking for Robust and Efficient Augmented Reality on Smartphones

This paper aims at robust and efficient pose tracking for augmented reality on modern smartphones. Existing methods, relying on either vision analysis or motion sensing, are either too computationally expensive to achieve real-time performance on a smartphone, or too noisy to achieve sufficient robustness. This paper presents a hybrid tracking system which can achieve realtime performance with high robustness. Our system utilizes an efficient featureless method based on pixel-based registration to track the object pose on every frame. The featureless tracking result is revised from time to time by a feature-based method to reduce tracking errors. Both featureless and feature-based tracking results are sensitive to large motion blurs. To improve the robustness, an adaptive Kamlan filter is proposed to fuse the visual tracking results with the inertial tracking results computed form phone’s built-in sensors. Our hybrid method is evaluated on a dataset consisting of 16 video clips with...

• Type: Journal
• Year: 2015
• Where: MM
• Authors: Xin Yang, Xun Si, Tangli Xue, Liheng Zhang, Kwang-Ting (Tim) Cheng
• Keywords: MM 2015, Multimedia