Conditional Sequence Model for Context-Based Recognition of Gaze Aversion

Eye gaze and gesture form key conversational grounding cues that are used extensively in face-to-face interaction among people. To accurately recognize visual feedback during interaction, people often use contextual knowledge from previous and current events to anticipate when feedback is most likely to occur. In this paper, we investigate how dialog context from an embodied conversational agent (ECA) can improve visual recognition of eye gestures. We propose a new framework for contextual recognition based on Latent-Dynamic Conditional Random Field (LDCRF) models to learn the sub-structure and external dynamics of contextual cues. Our experiments show that adding contextual information improves visual recognition of eye gestures and demonstrate that the LDCRF model for context-based recognition of gaze aversion gestures outperforms Support Vector Machines, Hidden Markov Models, and Conditional Random Fields. Key words: Contextual information, Conditional Random Fields, Eye gesture rec...

• Type: Conference
• Year: 2007
• Where: MLMI
• Authors: Louis-Philippe Morency, Trevor Darrell
• Keywords: Conditional Random Fields, Eye Gesture, Machine Learning, MLMI 2007, Visual Recognition