Detection, tracking, and classification of action units in facial expression

Most of the current work on automated facial expression analysis attempt to recognize a small set of prototypic expressions, such as joy and fear. Such prototypic expressions, however, occur infrequently, and human emotions and intentions are communicated more often by changes in one or two discrete features. To capture the full range of facial expression, detection, tracking, and classification of fine-grained changes in facial features are needed. We developed the first version of a computer vision system that is sensitive to subtle changes in the face. The system includes three modules to extract feature information: dense-flow extraction using a wavelet motion model, facial-feature tracking, and edge and line extraction. The feature information thus extracted is fed to discriminant classifiers or hidden Markov models that classify it into FACS action units, the descriptive system to code fine-grained changes in facial expression. The system was tested on image sequences from 100 m...

• Type: Journal
• Year: 2000
• Where: RAS
• Authors: James Jenn-Jier Lien, Takeo Kanade, Jeffrey F. Cohn, Ching-Chung Li
• Keywords: Facial Expression, Fine-grained Changes, Prototypic Expressions, RAS 2000