Sciweavers

64 search results - page 4 / 13
» Crowdsourcing Inference-Rule Evaluation
Sort
View
ACL
2011
12 years 11 months ago
They Can Help: Using Crowdsourcing to Improve the Evaluation of Grammatical Error Detection Systems
Despite the rising interest in developing grammatical error detection systems for non-native speakers of English, progress in the field has been hampered by a lack of informative...
Nitin Madnani, Martin Chodorow, Joel R. Tetreault,...
SIGIR
2012
ACM
11 years 10 months ago
Inferring missing relevance judgments from crowd workers via probabilistic matrix factorization
In crowdsourced relevance judging, each crowd worker typically judges only a small number of examples, yielding a sparse and imbalanced set of judgments in which relatively few wo...
Hyun Joon Jung, Matthew Lease
CIKM
2011
Springer
12 years 7 months ago
Worker types and personality traits in crowdsourcing relevance labels
Crowdsourcing platforms offer unprecedented opportunities for creating evaluation benchmarks, but suffer from varied output quality from crowd workers who possess different levels...
Gabriella Kazai, Jaap Kamps, Natasa Milic-Frayling
CHI
2010
ACM
14 years 2 months ago
Crowdsourcing graphical perception: using mechanical turk to assess visualization design
Understanding perception is critical to effective visualization design. With its low cost and scalability, crowdsourcing presents an attractive option for evaluating the large des...
Jeffrey Heer, Michael Bostock
ICASSP
2011
IEEE
12 years 11 months ago
CROWDMOS: An approach for crowdsourcing mean opinion score studies
MOS (mean opinion score) subjective quality studies are used to evaluate many signal processing methods. Since laboratory quality studies are time consuming and expensive, researc...
Flavio Ribeiro, Dinei A. F. Florêncio, Cha Z...