Deriving the Optimal Modality Combination for Searching in Multidimensional Databases

The European MIAMM-project (Multidimensional Information Access using Multiple Modalities) develops new concepts and techniques for multimodal dialogs that allow for fast and natural mobile access to multimedia databases. In an experiment we investigated different modality combinations (haptic-tactile, non-speech audio and a redundant combination) for conveying information on the size of a data-set. The results show that users perform better in the condition with redundant non-speech audio and haptic-tactile feedback and also prefer this condition. The knowledge gained in this experiment will be extended in the course of the MIAMM-project to possibly cover other contexts, tasks and to do testing in realistic environments. KEYWORDS Multimodal interfaces for handhelds, usability, UI-design, multidimensional databases.

• Type: Conference
• Year: 2003
• Where: IADIS
• Authors: Myra P. van Esch-Bussemakers, Anita H. M. Cremers, Mark A. Neerincx, Astrif J. van der Flier
• Keywords: IADIS 2003, IADIS 2008, Multidimensional Information Access, Non-speech Audio, Redundant Non-speech Audio