Sciweavers

ACL
2001

Using a Randomised Controlled Clinical Trial to Evaluate an NLG System

14 years 25 days ago
Using a Randomised Controlled Clinical Trial to Evaluate an NLG System
The STOP system, which generates personalised smoking-cessation letters, was evaluated by a randomised controlled clinical trial. We believe this is the largest and perhaps most rigorous task effectiveness evaluation ever performed on an NLG system. The detailed results of the clinical trial have been presented elsewhere, in the medical literature. In this paper we discuss the clinical trial itself: its structure and cost, what we did and did not learn from it (especially considering that the trial showed that STOP was not effective), and how it compares to other NLG evaluation techniques.
Ehud Reiter, Roma Robertson, A. Scott Lennox, Lies
Added 31 Oct 2010
Updated 31 Oct 2010
Type Conference
Year 2001
Where ACL
Authors Ehud Reiter, Roma Robertson, A. Scott Lennox, Liesl Osman
Comments (0)