155 search results - page 5 / 31 » On the effectiveness of evaluating retrieval systems in the ... |
SIGIR
2010
ACM
13 years 11 months ago
2010
ACM
Traditional retrieval evaluation uses explicit relevance judgments which are expensive to collect. Relevance assessments inferred from implicit feedback such as click-through data...
SIGIR
2008
ACM
13 years 7 months ago
2008
ACM
There has been recent interest in collecting user or assessor preferences, rather than absolute judgments of relevance, for the evaluation or learning of ranking algorithms. Since...
SIGIR
2012
ACM
11 years 9 months ago
2012
ACM
In this paper, we propose a novel top-k learning to rank framework, which involves labeling strategy, ranking model and evaluation measure. The motivation comes from the difficul...
SIGIR
2002
ACM
13 years 7 months ago
2002
ACM
This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we tr...
SIGIR
2004
ACM
14 years 24 days ago
2004
ACM
Forming test collection relevance judgments from the pooled output of multiple retrieval systems has become the standard process for creating resources such as the TREC, CLEF, and...