Dancing the night away: controlling a virtual karaoke dancer by multimodal expressive cues

In this article, we propose an approach of nonverbal interaction with virtual agents to control agents' behavioral expressivity by extracting and combining acoustic and gestural features. The goal for this approach is twofold, (i) expressing individual features like situated arousal and personal style and (ii) transmitting this information in an immersive 3D environment by suitable means. Categories and Subject Descriptors I.5.5 [Pattern Recognition]: Implementation--interactive systems General Terms Human factors Keywords multimodal interaction, expressivity recognition

• Type: Conference
• Year: 2008
• Where: ATAL
• Authors: Matthias Rehm, Thurid Vogt, Michael Wissner, Nikolaus Bee
• Keywords: ATAL 2008, Behavioral Expressivity, Immersive 3D Environment, Intelligent Agents, Keywords Multimodal Interaction