Mouthbrush: drawing and painting by hand and mouth

We present a novel multimodal interface which permits users to draw or paint using coordinated gestures of hand and mouth. A headworn camera captures an image of the mouth and the mouth cavity region is extracted by Fisher discriminant analysis of the pixel colour information. A normalized area parameter is read by a drawing or painting program to allow read-time gestural control of pen/brush parameters by mouth gesture while sketching with a digital pen/tablet. A new performance task, the Radius Control Task, is proposed as a means of systematic evaluation of performance of the interface. Data from preliminary experiments show that with some practice users can achieve single pixel radius control with ease. A trial of the system by a professional artist shows that it is ready for use as a novel tool for creative artistic expression. Categories and Subject Descriptors I.3.1 [Computer Graphics]: Hardware Architecture – Input devices. I.5.5 [Pattern Recognition]: Implementation – Int...

• Type: Conference
• Year: 2003
• Where: ICMI
• Authors: Chi-Ho Chan, Michael J. Lyons, Nobuji Tetsutani
• Keywords: ICMI 2003, Mouth Cavity Region, Mouth Gesture, Radius Control