Multimodal transformed social interaction

Understanding human-human interaction is fundamental to the long-term pursuit of powerful and natural multimodal interfaces. Nonverbal communication, including body posture, gesture, facial expression, and eye gaze, is an important aspect of human-human interaction. We introduce a paradigm for studying multimodal and nonverbal communication in collaborative virtual environments (CVEs) called Transformed Social Interaction (TSI), in which a user’s visual representation is rendered in a way that strategically filters selected communication behaviors in order to change the nature of a social interaction. To achieve this, TSI must employ technology to detect, recognize, and manipulate behaviors of interest, such as facial expressions, gestures, and eye gaze. In [13] we presented a TSI experiment called non-zero-sum gaze (NZSG) to determine the effect of manipulated eye gaze on persuasion in a small group setting. Eye gaze was manipulated so that each participant in a three-person CVE re...

• Type: Conference
• Year: 2004
• Where: ICMI
• Authors: Matthew Turk, Jeremy N. Bailenson, Andrew C. Beall, Jim Blascovich, Rosanna E. Guadagno
• Keywords: Eye Gaze, Human-human Interaction, ICMI 2004, Social Interaction