Evaluation of multimodal input for entering mathematical equations on the computer

Current standard interfaces for entering mathematical equations on computers are arguably limited and cumbersome. Mathematics notations have evolved to aid visual thinking and yet text-based interfaces relying on keyboard-and-mouse input do not take advantage of the natural two-dimensional aspects of math. Due to its similarities to paper-based mathematics, pen-based handwriting input may be faster, more efficient, and more preferable for entering mathematics on computers. This paper presents an empirical study that tests this hypothesis. We also explored a multimodal input method combining handwriting and speech because we hypothesize that it may enhance computer recognition and aid user cognition. Novice users were indeed faster, more efficient and enjoyed the handwriting modality more than a standard keyboardand-mouse mathematics interface, especially as equation length and complexity increased. The multimodal handwriting-plus-speech method was faster and better liked than the keyb...

• Type: Conference
• Year: 2005
• Where: CHI
• Authors: Lisa Anthony, Jie Yang, Kenneth R. Koedinger
• Keywords: CHI 2005, Current Standard Interfaces, Human Computer Interaction, Multimodal Input Method, Pen-based Handwriting Input