Sciweavers

242 search results - page 29 / 49
» Measures for Term and Sentence Relevances: an Evaluation for...
Sort
View
CIKM
2010
Springer
13 years 6 months ago
Web search solved?: all result rankings the same?
The objective of this work is to derive quantitative statements about what fraction of web search queries issued to the state-of-the-art commercial search engines lead to excellen...
Hugo Zaragoza, Berkant Barla Cambazoglu, Ricardo A...
CIKM
2009
Springer
14 years 21 days ago
Empirical justification of the gain and discount function for nDCG
The nDCG measure has proven to be a popular measure of retrieval effectiveness utilizing graded relevance judgments. However, a number of different instantiations of nDCG exist, d...
Evangelos Kanoulas, Javed A. Aslam
SIGIR
2009
ACM
14 years 3 months ago
Score adjustment for correction of pooling bias
Information retrieval systems are evaluated against test collections of topics, documents, and assessments of which documents are relevant to which topics. Documents are chosen fo...
William Webber, Laurence A. F. Park
SIGIR
2009
ACM
14 years 3 months ago
A study of inter-annotator agreement for opinion retrieval
Evaluation of sentiment analysis, like large-scale IR evaluation, relies on the accuracy of human assessors to create judgments. Subjectivity in judgments is a problem for relevan...
Adam Bermingham, Alan F. Smeaton
MLMI
2007
Springer
14 years 2 months ago
Towards an Objective Test for Meeting Browsers: The BET4TQB Pilot Experiment
This paper outlines first the BET method for task-based evaluation of meeting browsers. ‘Observations of interest’ in meetings are empirically determined by neutral observers ...
Andrei Popescu-Belis, Philippe Baudrion, Mike Flyn...