229 search results - page 8 / 46 » Evaluation measures for preference judgments |
SIGIR
2006
ACM
14 years 2 months ago
2006
ACM
We consider the problem of evaluating retrieval systems using a limited number of relevance judgments. Recent work has demonstrated that one can accurately estimate average precis...
CORR
2010
Springer
13 years 7 months ago
2010
Springer
We analyze judgement aggregation problems in which a group of agents independently votes on a set of complex propositions that has some interdependency constraint between them (e....
ACL
2011
13 years 1 days ago
2011
A lack of standard datasets and evaluation metrics has prevented the field of paraphrasing from making the kind of rapid progress enjoyed by the machine translation community ove...
CIKM
2006
Springer
14 years 4 days ago
2006
Springer
Familiar evaluation methodologies for information retrieval (IR) are not well suited to the task of comparing systems in many real settings. These systems and evaluation methods m...
JUCS
2008
13 years 8 months ago
2008
: Some measures such as mean average precision and recall level precision are considered as good system-oriented measures, because they concern both precision and recall that are t...