Evaluating Interactive Cross-Language Information Retrieval: Document Selection

Abstract. The problem of nding documents that are written in a language that the searcher cannot read is perhaps the most challenging application of Cross-Language Information Retrieval (CLIR) technology. The rst Cross-Language Evaluation Forum (CLEF) provided an excellent venue for assessing the performance of automated CLIR techniques, but little is known about how searchers and systems might interact to achieve better cross-language search results than automated systems alone can provide. This paper explores the question of how interactive approaches to CLIR might be evaluated, suggesting an initial focus on evaluation of interactive document selection. Important evaluation issues are identi ed, the structure of an interactive CLEF evaluation is proposed, and the key research communities that could be brought together by such an evaluation are introduced.

• Type: Conference
• Year: 2000
• Where: CLEF
• Authors: Douglas W. Oard
• Keywords: CLEF 2000, Cross-language Information Retrieval, Information Management, Interactive Clef Evaluation, Rst Cross-language Evaluation