Multimodal end-of-turn prediction in multi-party meetings

One of many skills required to engage properly in a conversation is to know the appropiate use of the rules of engagement. In order to engage properly in a conversation, a virtual human or robot should, for instance, be able to know when it is being addressed or when the speaker is about to hand over the turn. The paper presents a multimodal approach to end-of-speaker-turn prediction using sequential probabilistic models (Conditional Random Fields) to learn a model from observations of real-life multi-party meetings. Although the results are not as good as expected, we provide insight into which modalities are important when taking a multimodal approach to the problem based on literature and our own results. Categories and Subject Descriptors I.2.7 [Artificial Intelligence]: Natural Language Processing—Discourse; I.2.11 [Artificial Intelligence]: Distributed Artificial Intelligence—Intelligent agents General Terms Performance, Theory Keywords Multimodal, End-of-Turn Prediction,...

• Type: Conference
• Year: 2009
• Where: ICMI
• Authors: Iwan de Kok, Dirk Heylen
• Keywords: Artificial Intelligence, Biometrics, Conditional Random Fields, ICMI 2009, Multimodal Approach