Coordinating Text and Graphics in Explanation Generation

To generate multimedia explanations, a system must be able to coordinate the use of different media in a single explanation. In this paper, we present an architecture that we have developed for COMET (COordinated Multimedia Explanation Testbed), a system that generates directions for equipment maintenance and repair, and we show how it addresses the coordination problem. In particular, we focus on the use of a single content planner that produces a common content description used by multiple media-specific generators, a media coordinator that makes a f'me-grained division of information between media, and bidirectional interaction between media-specific generators to allow influence across media.

• Type: Conference
• Year: 1990
• Where: AAAI
• Authors: Steven Feiner, Kathleen McKeown
• Keywords: AAAI 1990, Intelligent Agents, Media-specific Generators, Multimedia Explanation, Single Content Planner