Sciweavers

1900 search results - page 14 / 380
» Crowdsourcing for relevance evaluation
Sort
View
CVPR
2012
IEEE
11 years 10 months ago
SUN attribute database: Discovering, annotating, and recognizing scene attributes
In this paper we present the first large-scale scene attribute database. First, we perform crowd-sourced human studies to find a taxonomy of 102 discriminative attributes. Next,...
Genevieve Patterson, James Hays
VLDB
1991
ACM
165views Database» more  VLDB 1991»
13 years 11 months ago
Aggregation and Relevance in Deductive Databases
In this paper we present a technique to optimize queries on deductive databases that use aggregate operations such as min, max, and “largest Ic values.” Our approach is based ...
S. Sudarshan, Raghu Ramakrishnan
CIKM
2007
Springer
13 years 11 months ago
Hypothesis testing with incomplete relevance judgments
Information retrieval experimentation generally proceeds in a cycle of development, evaluation, and hypothesis testing. Ideally, the evaluation and testing phases should be short ...
Ben Carterette, Mark D. Smucker
MIE
2008
138views Healthcare» more  MIE 2008»
13 years 9 months ago
The Contextual Nature of Usability and its Relevance to Medical Informatics
We report from three usability evaluations of health information systems that illustrate the value of seeing usability as a context dependent property of a product. We show how the...
Dag Svanæs, Anita Das, Ole Andreas Alsos
SIGIR
2008
ACM
13 years 7 months ago
Intuition-supporting visualization of user's performance based on explicit negative higher-order relevance
Modeling the beyond-topical aspects of relevance are currently gaining popularity in IR evaluation. For example, the discounted cumulated gain (DCG) measure implicitly models some...
Heikki Keskustalo, Kalervo Järvelin, Ari Pirk...