134 search results - page 1 / 27 » A Study of the Assessment of Relevance for the INEX'02 Test ... |
ECIR
2004
Springer
13 years 11 months ago
2004
Springer
We investigate possible assessment trends and inconsistencies within the collected relevance assessments of the INEX'02 test collection in order to provide a critical analysis...
SIGIR
2002
ACM
13 years 9 months ago
2002
ACM
Most test collections (like TREC and CLEF) for experimental research in information retrieval apply binary relevance assessments. This paper introduces a four-point relevance scal...
IR
2006
13 years 9 months ago
2006
Search facilitated with agglomerative hierarchical clustering methods was studied in a collection of Finnish newspaper articles (N = 53,893). To allow quick experiments, clustering...
SIGIR
2008
ACM
13 years 9 months ago
2008
ACM
We investigate to what extent people making relevance judgements for a reusable IR test collection are exchangeable. We consider three classes of judge: "gold standard" ...
ECIR
2007
Springer
13 years 11 months ago
2007
Springer
In this paper we a propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new protocol aims to identify ...