On the Evaluation of Snippet Selection for WebCLEF

WebCLEF is about supporting a user who is an expert in writing a survey article on a specific topic with a clear goal and audience by generating a ranked list with relevant snippets. This paper focuses on the evaluation methodology of WebCLEF. We show that the evaluation method and test set used for WebCLEF 2007 cannot be used to evaluate new systems and give recommendations how to improve the evaluation.

• Type: Conference
• Year: 2008
• Where: CLEF
• Authors: Arnold Overwijk, Dong Nguyen, Claudia Hauff, Dolf Trieschnigg, Djoerd Hiemstra, Franciska de Jong
• Keywords: Clear Goal, CLEF 2008, Evaluation Methodology, Information Management, Specific Topic