Multimodal floor control shift detection

Floor control is a scheme used by people to organize speaking turns in multi-party conversations. Identifying the floor control shifts is important for understanding a conversation’s structure and would be helpful for more natural human computer interaction systems. Although people tend to use verbal and nonverbal cues for managing floor control shifts, only audio cues, e.g., lexical and prosodic cues, have been used in most previous investigations on speaking turn prediction. In this paper, we present a statistical model to automatically detect floor control shifts using both verbal and nonverbal cues. Our experimental results show that using a combination of verbal and nonverbal cues provides more accurate detection. Categories and Subject Descriptors H.5.1 [Multimedia Information Systems]: [Audio and Video Input]; H.5.5 [Sound and Music Computing]: [Modeling and Signal Analysis]; I.2.7 [Natural Language Processing]: [Meeting Processing] General Terms Algorithms, Design, Experi...

• Type: Conference
• Year: 2009
• Where: ICMI
• Authors: Lei Chen 0004, Mary P. Harper
• Keywords: Biometrics, ICMI 2009, Nonverbal Cues, Prosodic Cues, floor Control Shifts