We study correlation of rankings of text summarization systems using evaluation methods with and without human models. We apply our comparison framework to various well-establishe...
Horacio Saggion, Juan Manuel Torres Moreno, Iria d...
We investigate the consistency of human assessors involved in summarization evaluation to understand its effect on system ranking and automatic evaluation techniques. Using Text A...
Karolina Owczarzak, Peter A. Rankel, Hoa Trang Dan...
We present a fully automatic method for content selection evaluation in summarization that does not require the creation of human model summaries. Our work capitalizes on the assu...
In recent years, there has been increased interest in topic-focused multi-document summarization. In this task, automatic summaries are produced in response to a specific informat...
Lucy Vanderwende, Hisami Suzuki, Chris Brockett, A...