Sciweavers

229 search results - page 3 / 46
» Evaluation measures for preference judgments
Sort
View
SIGIR
2003
ACM
14 years 1 months ago
On the effectiveness of evaluating retrieval systems in the absence of relevance judgments
Soboroff, Nicholas and Cahan recently proposed a method for evaluating the performance of retrieval systems without relevance judgments. They demonstrated that the system evaluat...
Javed A. Aslam, Robert Savell
SIGIR
2004
ACM
14 years 1 months ago
Retrieval evaluation with incomplete information
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
Chris Buckley, Ellen M. Voorhees
ICDIM
2007
IEEE
14 years 2 months ago
Several methods of ranking retrieval systems with partial relevance judgment
: Some measures such as average precision over all relevant documents and recall level precision are considered as good system-oriented measures, because they concern both precisio...
Shengli Wu, Sally I. McClean
4OR
2006
118views more  4OR 2006»
13 years 8 months ago
Dealing with inconsistent judgments in multiple criteria sorting models
Sorting models consist in assigning alternatives evaluated on several criteria to ordered categories. To implement such models it is necessary to set the values of the preference p...
Vincent Mousseau, Luis C. Dias, José Rui Fi...
CORR
2011
Springer
165views Education» more  CORR 2011»
13 years 5 days ago
Semantic Similarity in a Taxonomy: An Information-Based Measure and its Application to Problems of Ambiguity in Natural Language
This article presents a measure of semantic similarity in an is-a taxonomy based on the notion of shared information content. Experimental evaluation against a benchmark set of hu...
Philip Resnik