Sciweavers

1900 search results - page 18 / 380
» Crowdsourcing for relevance evaluation
Sort
View
ECIR
2004
Springer
13 years 9 months ago
A Study of the Assessment of Relevance for the INEX'02 Test Collection
We investigate possible assessment trends and inconsistencies within the collected relevance assessments of the INEX'02 test collection in order to provide a critical analysis...
Gabriella Kazai, Sherezad Masood, Mounia Lalmas
CLEF
2010
Springer
13 years 8 months ago
New Strategies for Image Annotation: Overview of the Photo Annotation Task at ImageCLEF 2010
The ImageCLEF 2010 Photo Annotation Task poses the challenge of automated annotation of 93 visual concepts in Flickr photos. The participants were provided with a training set of 8...
Stefanie Nowak, Mark J. Huiskes
CSCW
2012
ACM
12 years 3 months ago
Community-based web security: complementary roles of the serious and casual contributors
Does crowdsourcing work for web security? While the herculean task of evaluating hundreds of millions of websites can certainly benefit from the wisdom of crowds, skeptics questi...
Pern Hui Chia, John Chuang
INEX
2004
Springer
14 years 1 months ago
Using a Relevance Propagation Method for Adhoc and Heterogeneous Tracks at INEX 2004
This paper describes the evaluation of the XFIRM system in INEX 2004 framework. The XFIRM system uses a relevance propagation method to answer queries composed of content condition...
Karen Sauvagnat, Mohand Boughanem
SPIRE
2005
Springer
14 years 1 months ago
Retrieval Status Values in Information Retrieval Evaluation
Retrieval systems rank documents according to their retrieval status values (RSV) if these are monotonously increasing with the probability of relevance of documents. In this work,...
Amélie Imafouo, Xavier Tannier