Overview of the Answer Validation Exercise 2008

The Answer Validation Exercise at the Cross Language Evaluation Forum (CLEF) is aimed at developing systems able to decide whether the answer of a Question Answering (QA) system is correct or not. We present here the exercise description, the changes in the evaluation with respect to the last edition, and the results of this third edition (AVE 2008). Last year's changes allowed us to measure the possible gain in performance obtained by using AV systems as the selection method of QA systems. In this edition we wanted to reward AV systems able to detect if all the candidate answers to a question are incorrect. 9 groups have participated with 24 runs in 5 different languages, and compared with the QA systems, the results show an evidence of the potential gain that more sophisticated AV modules might introduce in the task of QA. Keywords Question Answering, Evaluation, Textual Entailment, Answer Validation

• Type: Conference
• Year: 2008
• Where: CLEF
• Authors: Álvaro Rodrigo, Anselmo Peñas, Felisa Verdejo
• Keywords: Answer Validation, CLEF 2008, Information Management, QA Systems, Question Answering