Context-based question-answering evaluation

In this poster, we will present the results of efforts we have undertaken to conduct evaluations of a QA system in a real world environment and to understand the nature of the dimensions on which users evaluate QA systems when given full reign to comment on whatever dimensions they deem important. Categories and Subject Descriptors H.3.4 Systems and Software Performance Evaluation General Terms Measurement Keywords Question-answering systems, question taxonomies, question understanding, real-time systems.

• Type: Conference
• Year: 2004
• Where: SIGIR
• Authors: Elizabeth D. Liddy, Anne Diekema, Ozgur Yilmazel
• Keywords: Descriptors H.3.4 Systems, Keywords Question-answering Systems, QA Systems, SIGIR 2004