Temporal Segmentation of Facial Behavior

Temporal segmentation of facial gestures in spontaneous facial behavior recorded in real-world settings is an important, unsolved, and relatively unexplored problem in facial image analysis. Several issues contribute to the challenge of this task. These include non-frontal pose, moderate to large out-of-plane head motion, large variability in the temporal scale of facial gestures, and the exponential nature of possible facial action combinations. To address these challenges, we propose a two-step approach to temporally segment facial behavior. The first step uses spectral graph techniques to cluster shape and appearance features invariant to some geometric transformations. The second step groups the clusters into temporally coherent facial gestures. We evaluated this method in facial behavior recorded during face-toface interactions. The video data were originally collected to answer substantive questions in psychology without concern for algorithm development. The method achieved mod...

• Type: Conference
• Year: 2007
• Where: ICCV
• Authors: Fernando De la Torre, Joan Campoy, Zara Ambadar, Jeff F. Conn
• Keywords: Coherent Facial Gestures, Computer Vision, Facial Action Combinations, Facial Image Analysis, ICCV 2007, Spontaneous Facial Behavior, Unusual Facial Behavior