Face as Mouse Through Visual Face Tracking

This paper introduces a novel camera mouse driven by 3D model based visual face tracking. While camera becomes standard configuration for personal computer(PC) and computer speed becomes faster and faster, achieving human machine interaction through visual face tracking becomes a feasible solution to hand-free control. The human facial movement can be decomposed into rigid motions including rotation and translation, and non-rigid motions, such as the open,close and stretch of mouth. We introduce our visual face tracking system that can robustly and accurately retrieve these motion parameters from video at real-time. The retrieved head orientation parameters can be employed to navigate the mouse cursor, and the detection of mouth motions triggers mouse events. 3 mouse control modes are investigated. Their usability are compared. Experiments in Windows XP environment verifies the convenience of our camera mouse driven by head and facial motion. This technique can be an alternative inp...

• Type: Conference
• Year: 2005
• Where: CRV
• Authors: Jilin Tu, Thomas S. Huang, Hai Tao
• Keywords: Camera Mouse, CRV 2005, Mouse Control Modes, Robotics, Visual Face Tracking