Affect as Information about Users' Attitudes to Conversational Agents

This paper presents a novel method for automatic evaluation of conversational agents. In the method, information about users’ attitudes and sentiments to conversational agents and their performance are achieved by analyzing their general emotional engagement in the conversation and specific affective states, and interpreting them using psychological reasoning of Affect-as-Information. In the evaluation experiment the users’ attitudes to two Japanesespeaking conversational agents were checked simultaneously in a survey and using a system constructed on the proposed method. The results returned by the system revealed similar tendencies as the survey. Therefore the method is applicable as a mean of evaluation for Japanese-speaking conversational agents.

• Type: Conference
• Year: 2008
• Where: IAT
• Authors: Michal Ptaszynski, Pawel Dybala, Shinsuke Higuchi, Rafal Rzepka, Kenji Araki
• Keywords: Conversational Agents, Evaluation, IAT 2008, Intelligent Agent, Japanese-speaking Conversational Agents