Conversing with the user based on eye-gaze patterns

Motivated by and grounded in observations of eye-gaze patterns in human-human dialogue, this study explores using eye-gaze patterns in managing human-computer dialogue. We developed an interactive system, iTourist, for city trip planning, which encapsulated knowledge of eyegaze patterns gained from studies of human-human collaboration systems. User study results show that it was possible to sense users' interest based on eye-gaze patterns and manage computer information output accordingly. Study participants could successfully plan their trip with iTourist and positively rated their experience of using it. We demonstrate that eye-gaze could play an important role in managing future multimodal human-computer dialogues. ACM Classification Keywords H.5.2 [Information interfaces and Presentation]: User Interfaces ? Input devices and strategies Author Keywords Multimodal interaction, dialogue systems, eye tracking, interest detection

• Type: Conference
• Year: 2005
• Where: CHI
• Authors: Pernilla Qvarfordt, Shumin Zhai
• Keywords: CHI 2005, Eye-gaze Patterns, Human Computer Interaction, Human-human Dialogue, Multimodal Human-computer Dialogues