Multimodal human-computer interaction: A survey

Abstract. In this paper we review the major approaches to multimodal human computer interaction from a computer vision perspective. In particular, we focus on body, gesture, gaze, and affective interaction (facial expression recognition, and emotion in audio). We discuss user and task modeling, and multimodal fusion, highlighting challenges, open issues, and emerging applications for Multimodal Human Computer Interaction (MMHCI) research.

• Type: Journal
• Year: 2007
• Where: CVIU
• Authors: Alejandro Jaimes, Nicu Sebe
• Keywords: Computer Vision Perspective, CVIU 2007, Human Computer Interaction, Multimodal Human Computer