Sciweavers

308 search results - page 4 / 62
» Measuring the Reusability of Test Collections
Sort
View
SIGIR
2008
ACM
13 years 7 months ago
Ambiguous queries: test collections need more sense
Although there are many papers examining ambiguity in Information Retrieval, this paper shows that there is a whole class of ambiguous word that past research has barely explored....
Mark Sanderson
SIGIR
2006
ACM
14 years 1 months ago
Minimal test collections for retrieval evaluation
Accurate estimation of information retrieval evaluation metrics such as average precision require large sets of relevance judgments. Building sets large enough for evaluation of r...
Ben Carterette, James Allan, Ramesh K. Sitaraman
SIGIR
2010
ACM
13 years 6 months ago
Blog track research at TREC
The TREC Blog track aims to explore information seeking behaviour in the blogosphere, by building reusable test collections for blog-related search tasks. Since, its advent in TRE...
Craig Macdonald, Rodrygo L. T. Santos, Iadh Ounis,...
SIGIR
2006
ACM
14 years 1 months ago
Bias and the limits of pooling
Modern retrieval test collections are built through a process called pooling in which only a sample of the entire document set is judged for each topic. The idea behind pooling is...
Chris Buckley, Darrin Dimmick, Ian Soboroff, Ellen...
SIGIR
2002
ACM
13 years 7 months ago
Do TREC web collections look like the web?
We measure the WT10g test collection, used in the TREC-9 and TREC 2001 Web Tracks, and the .GOV test collection used in the TREC 2002 Web and Interactive Tracks, with common measu...
Ian Soboroff