Generalization of a Vision-Based Computational Model of Mind-Reading

This paper describes a vision-based computational model of mind-reading that infers complex mental states from head and facial expressions in real-time. The generalization ability of the system is evaluated on videos that were posed by lay people in a relatively uncontrolled recording environment for six mental states—agreeing, concentrating, disagreeing, interested, thinking and unsure. The results show that the system’s accuracy is comparable to that of humans on the same corpus.

• Type: Conference
• Year: 2005
• Where: ACII
• Authors: Rana El Kaliouby, Peter Robinson
• Keywords: ACII 2005, Complex Mental States, Uncontrolled Recording Environment, Vision-based Computational Model