Drawing Pictures with Natural Language and Direct Manipulation

A multimodal user interface allows users to communicate with computers using multiple modalities, such as a mouse, a keyboard or voice, in various combined ways. This paper discusses a multimodal drawing tool, whereby the user can use a mouse, a keyboard and voice effectively. Also, it describes an interpretation method, by which the system integrates voice inputs and pointing inputs using context.

• Type: Conference
• Year: 1994
• Where: COLING
• Authors: Mayumi Hiyoshi, Hideo Shimazu
• Keywords: COLING 1994, COLING 2008, Multimodal Drawing Tool, Multimodal User Interface, Various Combined Ways