EmoEmma: emotional speech input for interactive storytelling

Whilst techniques for narrative generation and agent behaviour have made significant progress in recent years, natural language processing remains a bottleneck hampering the scalability of Interactive Storytelling systems. This demonstrator introduces a novel interaction technique based solely on emotional speech recognition. It allows the user to use speech to interact with virtual actors without any constraints on style or expressivity, by mapping the recognised emotional categories to narrative situations and virtual characters feelings. Categories and Subject Descriptors H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems. General Terms Algorithms, Human Factors. Keywords Interactive Storytelling, Emotional Speech Recognition, Embodied Conversational Agents.

• Type: Conference
• Year: 2009
• Where: ATAL
• Authors: Fred Charles, David Pizzi, Marc Cavazza, Thurid Vogt, Elisabeth André
• Keywords: Artificial Intelligence, ATAL 2009, Emotional Speech Recognition, Interactive Storytelling, Interactive Storytelling Systems