CrowdWeaver: visually managing complex crowd work

Though toolkits exist to create complex crowdsourced workflows, there is limited support for management of those workflows. Managing crowd workers and tasks requires significant iteration and experimentation on task instructions, rewards, and flows. We present CrowdWeaver, a system to visually manage complex crowd work. The system supports the creation and reuse of crowdsourcing and computational tasks into integrated task flows, manages the flow of data between tasks, and allows tracking and notification of task progress, with support for real-time modification. We describe the system and demonstrate its utility through case studies and user feedback. Author Keywords Crowdsourcing, workflow, visualization, coordination. ACM Classification Keywords H5.m. Information interfaces and presentation (e.g., HCI). General Terms Design

• Type: Journal
• Year: 2012
• Where: CSCW
• Authors: Aniket Kittur, Susheel Khamkar, Paul André, Robert Kraut
• Keywords: Computational Tasks, CSCW 2012, Information Interfaces, Social Sciences, Task Flows