Distributed pointing for multimodal collaboration over sketched diagrams

A problem faced by groups that are not co-located but need to collaborate on a common task is the reduced access to the rich multimodal communicative context that they would have access to if they were collaborating face-to-face. Collaboration support tools aim to reduce the adverse effects of this restricted access to the fluid intermixing of speech, gesturing, writing and sketching by providing mechanisms to enhance the awareness of distributed participants of each others’ actions. In this work we explore novel ways to leverage the capabilities of multimodal context-aware systems to bridge colocated and distributed collaboration contexts. We describe a system that allows participants at remote sites to collaborate in building a project schedule via sketching on multiple distributed whiteboards, and show how participants can be made aware of naturally occurring pointing gestures that reference diagram constituents as they are performed by remote participants. The system explores ...

• Type: Conference
• Year: 2005
• Where: ICMI
• Authors: Paulo Barthelmess, Edward C. Kaiser, Xiao Huang, David Demirdjian
• Keywords: ICMI 2005, Multimodal Communicative Context, Multimodal Context-aware Systems, Pointing Gestures