Sciweavers

242 search results - page 14 / 49
» Measures for Term and Sentence Relevances: an Evaluation for...
Sort
View
CIKM
2003
Springer
14 years 24 days ago
Using titles and category names from editor-driven taxonomies for automatic evaluation
Evaluation of IR systems has always been difficult because of the need for manually assessed relevance judgments. The advent of large editor-driven taxonomies on the web opens the...
Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury...
KDD
2009
ACM
248views Data Mining» more  KDD 2009»
14 years 4 days ago
PSkip: estimating relevance ranking quality from web search clickthrough data
1 In this article, we report our efforts in mining the information encoded as clickthrough data in the server logs to evaluate and monitor the relevance ranking quality of a commer...
Kuansan Wang, Toby Walker, Zijian Zheng
SIGIR
2009
ACM
14 years 6 days ago
Evaluating effects of machine translation accuracy on cross-lingual patent retrieval
We organized a machine translation (MT) task at the Seventh NTCIR Workshop. Participating groups were requested to machine translate sentences in patent documents and also search ...
Atsushi Fujii, Masao Utiyama, Mikio Yamamoto, Take...
LREC
2010
162views Education» more  LREC 2010»
13 years 9 months ago
Construction of a Benchmark Data Set for Cross-lingual Word Sense Disambiguation
Given the recent trend to evaluate the performance of word sense disambiguation systems in a more application-oriented set-up, we report on the construction of a multilingual benc...
Els Lefever, Véronique Hoste
SIGIR
2004
ACM
14 years 1 months ago
Retrieval evaluation with incomplete information
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
Chris Buckley, Ellen M. Voorhees