Sciweavers

123 search results - page 4 / 25
» A Retrieval Evaluation Methodology for Incomplete Relevance ...
Sort
View
CIKM
2006
Springer
13 years 11 months ago
Estimating average precision with incomplete and imperfect judgments
We consider the problem of evaluating retrieval systems using incomplete judgment information. Buckley and Voorhees recently demonstrated that retrieval systems can be efficiently...
Emine Yilmaz, Javed A. Aslam
CIKM
2003
Springer
14 years 20 days ago
Using titles and category names from editor-driven taxonomies for automatic evaluation
Evaluation of IR systems has always been difficult because of the need for manually assessed relevance judgments. The advent of large editor-driven taxonomies on the web opens the...
Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury...
CIVR
2008
Springer
127views Image Analysis» more  CIVR 2008»
13 years 9 months ago
Performance evaluation of relevance feedback methods
In this paper we review the evaluation of relevance feedback methods for content-based image retrieval systems. We start out by presenting an overview of current common practice, ...
Mark J. Huiskes, Michael S. Lew
JASIS
2008
121views more  JASIS 2008»
13 years 7 months ago
Experiments with transitive dictionary translation and pseudo-relevance feedback using graded relevance assessments
Research on cross-language information retrieval (CLIR) has typically been restricted to settings using binary relevance assessments. In this paper, we present evaluation results f...
Raija Lehtokangas, Heikki Keskustalo, Kalervo J&au...
SIGIR
2006
ACM
14 years 1 months ago
A statistical method for system evaluation using incomplete judgments
We consider the problem of large-scale retrieval evaluation, and we propose a statistical method for evaluating retrieval systems using incomplete judgments. Unlike existing techn...
Javed A. Aslam, Virgiliu Pavlu, Emine Yilmaz