Generating Coordinated Natural Language and 3D Animations for Complex Spatial Explanations

Dynamically providing students with clear explanations of complex spatial concepts is critical for a broad range of knowledge-based educational and training systems. This calls for a realtime solution that can dynamically create 3D animated explanations that artfully integrate well-chosen speech with rich visualizations. Unfortunately, planning the integrated creation of 3D animation and spatial linguistic utterances in realtime requires coordinating the visual presentation of 3D objects and generating appropriate spatial phrases that accurately re ect the relative position, orientation, and direction of the objects presented. We present a visuo-linguistic framework for generating multimedia spatial explanations combining 3D animation and speech that complement one another. Because 3D animation planners require spatial knowledge in a geometric form and natural language generators require spatial knowledge in a linguistic form, a realtime multimedia planner interposed between the visua...

• Type: Conference
• Year: 1998
• Where: AAAI
• Authors: Stuart G. Towns, Charles B. Callaway, James C. Lester
• Keywords: AAAI 1998, Intelligent Agents, Multimedia Spatial Explanations, Spatial, Spatial Linguistic Utterances