Generation of ground-truths is of great importance for unbiased performance evaluation of document layout analysis methods. This is especially necessary because many methods are c...
We discuss important factors in the design of evaluation studies for systems that generate animations of American Sign Language (ASL) sentences. In particular, we outline how some...
Matt Huenerfauth, Liming Zhao, Erdan Gu, Jan M. Al...
The paper briefly describes the First Shared Task Evaluation Challenge on Question Generation that took place in Spring 2010. The campaign included two tasks: Task A
Vasile Rus, Brendan Wyse, Paul Piwek, Mihai C. Lin...
Generative and evaluative approaches are two different ways of diagnosing students’ input that have been realized in a number of intelligent tutoring systems. We describe how Ac...
Automated evaluation is crucial in the context of automated text summaries, as is the case with evaluation of any of the language technologies. In this paper we present a Generativ...