Learning an appearance-based gaze estimator from one million synthesised images

Learning-based methods for appearance-based gaze estimation achieve state-of-the-art performance in challenging real-world settings but require large amounts of labelled training data. Learningby-synthesis was proposed as a promising solution to this problem but current methods are limited with respect to speed, the appearance variability as well as the head pose and gaze angle distribution they can synthesize. We present UnityEyes, a novel method to rapidly synthesize large amounts of variable eye region images as training data. Our method combines a novel generative 3D model of the human eye region with a real-time rendering framework. The model is based on high-resolution 3D face scans and uses realtime approximations for complex eyeball materials and structures as well as novel anatomically inspired procedural geometry methods for eyelid animation. We show that these synthesized images can be used to estimate gaze in difficult in-the-wild scenarios, even for extreme gaze angles o...

• Type: Journal
• Year: 2016
• Where: ETRA
• Authors: Erroll Wood, Tadas Baltrusaitis, Louis-Philippe Morency, Peter Robinson 0001, Andreas Bulling
• Keywords: Biometrics, ETRA 2016