A Framework of Evaluation for Question-Answering Systems

Evaluating complex system is a complex task. Evaluation campaigns are organized each year to test different systems on global results, but they do not evaluate the relevance of the criteria used. Our purpose consist in modifying the intermediate results created by the components and inserting the new results into the process, without modifying the components. We will describe our framework of glass-box evaluation.

• Type: Conference
• Year: 2009
• Where: ECIR
• Authors: Sarra El Ayari, Brigitte Grau
• Keywords: Complex Task, Computer Science, ECIR 2009, Evaluation Campaigns