We evaluated effects of gaze directional and other non-verbal visual cues on multiparty mediated communication. Groups of three participants (two actors, one subject) solved language puzzles in three audiovisual communication conditions. Each condition presented a different selection of images of the actors to subjects: (1) frontal motion video with 14% gaze; (2) motion video with head orientation and 7% gaze; (3) still images with head orientation and 32% gaze. Presence of head orientation cues caused subjects to use twice as many deictic references to persons. We found a linear relationship between the amount of actor gaze perceived by subjects and the number of speaking turns taken by subjects. Lack of gaze can decrease turn-taking efficiency of multiparty mediated systems by 25%. This is because gaze conveys whether one is being addressed or expected to speak, and is used to regulate social intimacy. Support for gaze directional cues in multiparty mediated systems is recommended. ...
Roel Vertegaal, Gerrit C. van der Veer, Harro Vons