Segment and recognize expression phase by fusion of motion area and neutral divergence features

—An expression can be approximated by a sequence of temporal segments called neutral, onset, offset and apex. However, it is not easy to accurately detect such temporal segments only based on facial features. Some researchers try to temporally segment expression phases with the help of body gesture analysis. The problem of this approach is that the expression temporal phases from face and gesture channels are not synchronized. Additionally, most previous work adopted facial key points tracking or body tracking to extract motion information, which is unreliable in practice due to illumination variations and occlusions. In this paper, we present a novel algorithm to overcome the above issues, in which two simple and robust features are designed to describe face and gesture information, i.e., motion area and neutral divergence features. Both features do not depend on motion tracking, and they can be easily calculated too. Moreover, it is different from previous work in that we integrate...

• Type: Journal
• Year: 2011
• Where: FGR
• Authors: Shizhi Chen, YingLi Tian, Qingshan Liu, Dimitris N. Metaxas
• Keywords: Biometrics, Body Gesture, E Motion, FGR 2011, Gesture Analysis