DOVE: drawing over video environment

We demonstrate a multimedia system that integrates pen-based gesture and live video to support collaboration on physical tasks. The system combines network IP cameras, desktop PCs, and tablet PCs (or PDAs) to allow a remote helper to draw on a video feed of a workspace as he/she provides task instructions. A gesture recognition component enables the system both to normalize freehand drawings to facilitate communication with remote partners and to use pen-based input as a camera control device. The system also embeds some tools, such as controlled video delay, gesture delay, and remote camera pan-tilt-zoom control. The system provides a software environment for studying multimodal/multimedia communication for remote collaborative physical tasks Categories and Subject Descriptors H.5.3 [Information Interfaces and Presentation]: Group and Organization Interfaces - Collaborative computing, Computersupported cooperative work. General Terms Design, Human Factors. Keywords Gestural communica...

• Type: Conference
• Year: 2003
• Where: MM
• Authors: Jiazhi Ou, Xilin Chen, Susan R. Fussell, Jie Yang
• Keywords: Gesture, Gesture Recognition, MM 2003, Video