Simultaneous Facial Action Tracking and Expression Recognition Using a Particle Filter

The recognition of facial gestures and expressions in image sequences is an important and challenging problem. Most of the existing methods adopt the following paradigm. First, facial actions/features are retrieved from the images, and then facial expressions are recognized based on the retrieved temporal parameters. Unlike this main stream, this paper introduces a new approach allowing the simultaneous recovery of facial actions and expression using a particle filter adopting multi-class dynamics that are conditioned on the expression. For each frame in the video sequence, our approach is split in two consecutive stages. In the first stage, the 3D head pose is recovered using a deterministic registration technique based on Online Appearance Models. In the second stage, the facial actions as well as the facial expression are simultaneously recovered using the stochastic framework with mixed states. The proposed fast scheme is either as robust as existing ones or more robust with respe...

• Type: Conference
• Year: 2005
• Where: ICCV
• Authors: Fadi Dornaika, Franck Davoine
• Keywords: Computer Vision, Facial Actions, Facial Actions/features, Facial Expression, Facial Expressions, Facial Gestures, ICCV 2005