A Unified Probabilistic Framework for Facial Activity Modeling and Understanding

Facial activities are the most natural and powerful means of human communication. Spontaneous facial activity is characterized by rigid head movements, non-rigid facial muscular movements, and their interactions. Current research in facial activity analysis is limited to recognizing rigid or non-rigid motion separately, often ignoring their interactions. Furthermore, although some of them analyze the temporal properties of facial features during facial feature extraction, they often recognize the facial activity statically, ignoring the dynamics of the facial activity. In this paper, we propose to explicitly exploit the prior knowledge about facial activities and systematically combine the prior knowledge with image measurements to achieve an accurate, robust, and consistent facial activity understanding. Specifically, we propose a unified probabilistic framework based on the dynamic Bayesian network (DBN) to simultaneously and coherently represent the rigid and non-rigid facial motio...

• Type: Conference
• Year: 2007
• Where: CVPR
• Authors: Yan Tong, Wenhui Liao, Zheng Xue, Qiang Ji
• Keywords: Computer Vision, Consistent Facial Activity, CVPR 2007, Facial Activity, Facial Activity Recognition, Non-rigid Facial Motions, Spontaneous Facial Activity