Visualizing the problems with the INEX topics

Topics form a crucial component of a test collection. We show, through visualization, that the INEX 2008 topics have shortcomings, which questions their validity for evaluating XML retrieval effectiveness. Categories and Subject Descriptors H.3 [Information Storage and Retrieval]: Information Search and Retrieval – Retrieval models, Search process. General Terms Reliability, Experimentation, Human Factors, Verification. Keywords INEX, XML-IR, element retrieval. IR methodology.

• Type: Conference
• Year: 2009
• Where: SIGIR
• Authors: Andrew Trotman, Maria del Rocio Gomez Crisostomo, Mounia Lalmas
• Keywords: Element Retrieval, INEX 2008 Topics, Information Retrieval, SIGIR 2009, XML Retrieval Effectiveness