Crosstrainer: testing the use of multimodal interfaces in situ

We report the results of an exploratory 8-day field study of CrossTrainer: a mobile game with crossmodal audio and tactile feedback. Our research focuses on the longitudinal effects on performance with audio and tactile feedback, the impact of context such as location and situation on performance and personal modality preference. The results of this study indicate that crossmodal feedback can aid users in entering answers quickly and accurately using a variety of different widgets. Our study shows that there are times when audio is more appropriate than tactile and vice versa and for this reason devices should support both tactile and audio feedback to cover the widest range of environments, user preference, locations and tasks. Author Keywords Tactile, audio, multimodal interaction, touchscreens, mobile interaction, crossmodal interaction. ACM Classification Keywords H5.m. Information interfaces and presentation: User Interfaces: Auditory (non-speech) feedback, Haptic I/O.

• Type: Conference
• Year: 2010
• Where: CHI
• Authors: Eve E. Hoggan, Stephen A. Brewster
• Keywords: CHI 2010, Exploratory 8-day Field, Human Computer Interaction, Personal Modality Preference, Tactile Feedback