Multimodal interface platform for geographical information systems (GeoMIP) in crisis management

A novel interface system for accessing geospatial data (GeoMIP) has been developed that realizes a user-centered multimodal speech/gesture interface for addressing some of the critical needs in crisis management. In this system we primarily developed vision sensing algorithms, speech integration, multimodality fusion, and rule-based mapping of multimodal user input to GIS database queries. A demo system of this interface has been developed for the Port Authority NJ/NY and is explained here. Categories and Subject Descriptors H.5.2 [Information Interfaces and Presentation]: User Interface – graphical user interfaces, input devices and strategies, interaction styles, natural language, user-centered design, voice I/O. General Terms Management, performance, design, reliability, human factors Keywords Multimodal human-computer-interface, gesture recogni-tion, human-centered design, collaboration, GIS, interactive maps.

• Type: Conference
• Year: 2004
• Where: ICMI
• Authors: Pyush Agrawal, Ingmar Rauschert, Keerati Inochanon, Levent Bolelli, Sven Fuhrmann, Isaac Brewer, Guoray Cai, Alan M. MacEachren, Rajeev Sharma
• Keywords: ICMI 2004, Multimodal User Input, User Interfaces, User-centered Multimodal Speech/gesture