Facial Action Unit Recognition by Exploiting Their Dynamic and Semantic Relationships

—A system that could automatically analyze the facial actions in real time has applications in a wide range of different fields. However, developing such a system is always challenging due to the richness, ambiguity, and dynamic nature of facial actions. Although a number of research groups attempt to recognize facial action units (AUs) by improving either the facial feature extraction techniques or the AU classification techniques, these methods often recognize AUs or certain AU combinations individually and statically, ignoring the semantic relationships among AUs and the dynamics of AUs. Hence, these approaches cannot always recognize AUs reliably, robustly, and consistently. In this paper, we propose a novel approach that systematically accounts for the relationships among AUs and their temporalevolutionsforAUrecognition.Specifically,we useadynamicBayesiannetwork(DBN)tomodeltherelationships amongdifferent AUs. The DBN provides a coherent and unified hierarchical probabilistic fra...

• Type: Journal
• Year: 2007
• Where: PAMI
• Authors: Yan Tong, Wenhui Liao, Qiang Ji
• Keywords: AU Measurements, Facial Action, PAMI 2007, Various Aus