Sciweavers

229 search results - page 10 / 46
» Evaluation measures for preference judgments
Sort
View
SIGIR
2009
ACM
14 years 2 months ago
A study of inter-annotator agreement for opinion retrieval
Evaluation of sentiment analysis, like large-scale IR evaluation, relies on the accuracy of human assessors to create judgments. Subjectivity in judgments is a problem for relevan...
Adam Bermingham, Alan F. Smeaton
TSMC
2002
149views more  TSMC 2002»
13 years 8 months ago
A consensus model for multiperson decision making with different preference structures
In this paper, we present a consensus model for multiperson decision making (MPDM) problems with different preference structures based on two consensus criteria: 1) a consensus mea...
Enrique Herrera-Viedma, Francisco Herrera, Francis...
SIGIR
2006
ACM
14 years 2 months ago
Minimal test collections for retrieval evaluation
Accurate estimation of information retrieval evaluation metrics such as average precision require large sets of relevance judgments. Building sets large enough for evaluation of r...
Ben Carterette, James Allan, Ramesh K. Sitaraman
SIGIR
2005
ACM
14 years 2 months ago
Automated evaluation of search engine performance via implicit user feedback
Measuring the information retrieval effectiveness of Web search engines can be expensive if human relevance judgments are required to evaluate search results. Using implicit user ...
Himanshu Sharma, Bernard J. Jansen
DAGM
2004
Springer
14 years 1 months ago
A Semantic Typicality Measure for Natural Scene Categorization
We propose an approach to categorize real-world natural scenes based on a semantic typicality measure. The proposed typicality measure allows to grade the similarity of an image wi...
Julia Vogel, Bernt Schiele