Sciweavers

ACL
1998

Evaluating Response Strategies in a Web-Based Spoken Dialogue Agent

14 years 24 days ago
Evaluating Response Strategies in a Web-Based Spoken Dialogue Agent
While the notion of a cooperative response has been the focus of considerable research in natural language dialogue systems, there has been little empirical work demonstrating how such responses lead to more efficient, natural, or successful dialogues. This paper presents an experimental evaluation of two alternative response strategies in TOOT, a spoken dialogue agent that allows users to access train schedules stored on the web via a telephone conversation. We compare the performance of two versions of TOOT (literal and cooperative), by having users carry out a set of tasks with each version. By using hypothesis testing methods, we show that a combination of response strategy, application task, and task/strategy interactions account for various types of performance differences. By using the PARADISE evaluation framework to estimate an overall performance function, we identify interdependencies that exist between speech recognition and response strategy. Our results elaborate the con...
Diane J. Litman, Shimei Pan, Marilyn A. Walker
Added 01 Nov 2010
Updated 01 Nov 2010
Type Conference
Year 1998
Where ACL
Authors Diane J. Litman, Shimei Pan, Marilyn A. Walker
Comments (0)