1900 search results - page 4 / 380 » Crowdsourcing for relevance evaluation |
SIGIR
2010
ACM
13 years 11 months ago
2010
ACM
We report on the construction of the PAN Wikipedia vandalism corpus, PAN-WVC-10, using Amazon’s Mechanical Turk. The corpus compiles 32 452 edits on 28 468 Wikipedia articles, a...
ESEM
2010
ACM
13 years 5 months ago
2010
ACM
The power and the generality of the findings obtained through empirical studies are bounded by the number and type of participating subjects. In software engineering, obtaining a ...
CSCW
2012
ACM
12 years 3 months ago
2012
ACM
Preparing complex jobs for crowdsourcing marketplaces requires careful attention to workflow design, the process of decomposing jobs into multiple tasks, which are solved by multi...
AAAI
2012
11 years 10 months ago
2012
We examine designs for crowdsourcing contests, where participants compete for rewards given to superior solutions of a task. We theoretically analyze tradeoffs between the expecta...
AAAI
2012
11 years 10 months ago
2012
We explore the problem of assigning heterogeneous tasks to workers with different, unknown skill sets in crowdsourcing markets such as Amazon Mechanical Turk. We first formalize ...