Sciweavers

134 search results - page 1 / 27
» A Study of the Assessment of Relevance for the INEX'02 Test ...
Sort
View
ECIR
2004
Springer
14 years 8 days ago
A Study of the Assessment of Relevance for the INEX'02 Test Collection
We investigate possible assessment trends and inconsistencies within the collected relevance assessments of the INEX'02 test collection in order to provide a critical analysis...
Gabriella Kazai, Sherezad Masood, Mounia Lalmas
SIGIR
2002
ACM
13 years 10 months ago
Liberal relevance criteria of TREC -: counting on negligible documents?
Most test collections (like TREC and CLEF) for experimental research in information retrieval apply binary relevance assessments. This paper introduces a four-point relevance scal...
Eero Sormunen
IR
2006
13 years 11 months ago
Hierarchical clustering of a Finnish newspaper article collection with graded relevance assessments
Search facilitated with agglomerative hierarchical clustering methods was studied in a collection of Finnish newspaper articles (N = 53,893). To allow quick experiments, clustering...
Tuomo Korenius, Jorma Laurikkala, Martti Juhola, K...
SIGIR
2008
ACM
13 years 10 months ago
Relevance assessment: are judges exchangeable and does it matter
We investigate to what extent people making relevance judgements for a reusable IR test collection are exchangeable. We consider three classes of judge: "gold standard" ...
Peter Bailey, Nick Craswell, Ian Soboroff, Paul Th...
ECIR
2007
Springer
14 years 10 days ago
A Retrieval Evaluation Methodology for Incomplete Relevance Assessments
In this paper we a propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new protocol aims to identify ...
Mark Baillie, Leif Azzopardi, Ian Ruthven