Sciweavers

229 search results - page 4 / 46
» Agreements Without Disagreements
Sort
View
CORR
2008
Springer
92views Education» more  CORR 2008»
13 years 7 months ago
Fixed Parameter Polynomial Time Algorithms for Maximum Agreement and Compatible Supertrees
Consider a set of labels L and a set of trees T = {T (1) , T (2) , . . . , T (k) } where each tree T (i) is distinctly leaf-labeled by some subset of L. One fundamental problem is ...
Viet Tung Hoang, Wing-Kin Sung
SIGIR
2012
ACM
11 years 9 months ago
Effect of written instructions on assessor agreement
Assessors frequently disagree on the topical relevance of documents. How much of this disagreement is due to ambiguity in assessment instructions? We have two assessors assess TRE...
William Webber, Bryan Toth, Marjorie Desamito
LREC
2008
128views Education» more  LREC 2008»
13 years 8 months ago
Adjudicator Agreement and System Rankings for Person Name Search
We have analyzed system rankings for person name search algorithms using a data set for which several versions of ground truth were developed by employing different means of resol...
Mark Arehart, Chris Wolf, Keith J. Miller
LREC
2010
131views Education» more  LREC 2010»
13 years 8 months ago
Determining Reliability of Subjective and Multi-label Emotion Annotation through Novel Fuzzy Agreement Measure
The paper presents a new fuzzy agreement measure f for determining the agreement in multi-label and subjective annotation task. In this annotation framework, one data item may bel...
Plaban Kr. Bhowmick, Anupam Basu, Pabitra Mitra
IJCAI
2003
13 years 8 months ago
On the Design of Social Diagnosis Algorithms for Multi-Agent Teams
Teamwork demands agreement among teammembers to collaborate and coordinate effectively. When a disagreement between teammates occurs (due to failures), team-members should ideally...
Meir Kalech, Gal A. Kaminka