Sciweavers

330 search results - page 6 / 66
» A statistical method for system evaluation using incomplete ...
Sort
View
SIGIR
2003
ACM
14 years 22 days ago
Automatic ranking of retrieval systems in imperfect environments
The empirical investigation of the effectiveness of information retrieval (IR) systems requires a test collection, a set of query topics, and a set of relevance judgments made by ...
Rabia Nuray, Fazli Can
JUCS
2008
117views more  JUCS 2008»
13 years 7 months ago
Ranking Retrieval Systems with Partial Relevance Judgements
: Some measures such as mean average precision and recall level precision are considered as good system-oriented measures, because they concern both precision and recall that are t...
Shengli Wu, Fabio Crestani
CORR
1998
Springer
87views Education» more  CORR 1998»
13 years 7 months ago
Resources for Evaluation of Summarization Techniques
We report on two corpora to be used in the evaluation of component systems for the tasks of (1) linear segmentation of text and (2) summary-directed sentence extraction. We presen...
Judith L. Klavans, Kathleen McKeown, Min-Yen Kan, ...
HICSS
2003
IEEE
93views Biometrics» more  HICSS 2003»
14 years 23 days ago
A General Method for Statistical Performance Evaluation
In the paper, we propose a general method for statistical performance evaluation. The method incorporates various statistical metrics and automatically selects an appropriate stat...
Longzhuang Li, Yi Shang, Wei Zhang, Hongchi Shi
SIGIR
2012
ACM
11 years 10 months ago
An uncertainty-aware query selection model for evaluation of IR systems
We propose a mathematical framework for query selection as a mechanism for reducing the cost of constructing information retrieval test collections. In particular, our mathematica...
Mehdi Hosseini, Ingemar J. Cox, Natasa Milic-Frayl...