Eye Gaze Correction with Stereovision for Video-Teleconferencing

Abstract. The lack of eye contact in desktop video teleconferencing substantially reduces the effectiveness of video contents. While expensive and bulky hardware is available on the market to correct eye gaze, researchers have been trying to provide a practical software-based solution to bring video-teleconferencing one step closer to the mass market. This paper presents a novel approach that is based on stereo analysis combined with rich domain knowledge (a personalized face model). This marriage is mutually beneficial. The personalized face model greatly improved the accuracy and robustness of the stereo analysis by substantially reducing the search range; the stereo techniques, using both feature matching and template matching, allow us to extract 3D information of objects other than the face and to determine the head pose in a much more reliable way than if only one camera is used. Thus we enjoy the versatility of stereo techniques without suffering from their vulnerability. By emp...

• Type: Conference
• Year: 2002
• Where: ECCV
• Authors: Ruigang Yang, Zhengyou Zhang
• Keywords: Computer Vision, ECCV 2002, Eye-gaze Corrected Video, Face Part, Personalized Face Model, Stereo Analysis, Stereo Techniques