Tracking Body Parts of Multiple People for Multi-person Multimodal Interface

Although large displays could allow several users to work together and to move freely in a room, their associated interfaces are limited to contact devices that must generally be shared. This paper describes a novel interface called SHIVA (Several-Humans Interface with Vision and Audio) allowing several users to interact remotely with a very large display using both speech and gesture. The head and both hands of each users are tracked in real time by a stereo vision based system. From the body parts position, the direction pointed by each user is computed and selection gestures done with the second hand are recognized. Pointing gesture is fused with n-best results from speech recognition taking into account the application context. The system is tested on a chess game with two users playing on a very large display.

• Type: Conference
• Year: 2005
• Where: ICCV
• Authors: Sébastien Carbini, Jean-Emmanuel Viallet, Olivier Bernier, Benedicte Bascle
• Keywords: Computer Vision, ICCV 2005, Interface Called Shiva, Large Display, Vision Based System