Speech pen: predictive handwriting based on ambient multimodal recognition

It is tedious to handwrite long passages of text by hand. To make this process more efficient, we propose predictive handwriting that provides input predictions when the user writes by hand. A predictive handwriting system presents possible next words as a list and allows the user to select one to skip manual writing. Since it is not clear if people are willing to use prediction, we first run a user study to compare handwriting and selecting from the list. The result shows that, in Japanese, people prefer to select, especially when the expected performance gain from using selection is large. Based on these observations, we designed a multimodal input system, called speech-pen, that assists digital writing during lectures or presentations with background speech and handwriting recognition. The system recognizes speech and handwriting in the background and provides the instructor with predictions for further writing. The speech-pen system also allows the sharing of context information f...

• Type: Conference
• Year: 2006
• Where: CHI
• Authors: Kazutaka Kurihara, Masataka Goto, Jun Ogata, Takeo Igarashi
• Keywords: CHI 2006, Human Computer Interaction, Multimodal Input System, Predictive Handwriting, Speech Recognition