Job Complexity and User Attention in Crowdsourcing Microtasks

Authors

  • Spencer Rothwell VoiceBox Technologies
  • Steele Carter VoiceBox Technologies
  • Ahmad Elshenawy VoiceBox Technologies
  • Daniela Braga VoiceBox Technologies

DOI:

https://doi.org/10.1609/hcomp.v3i1.13265

Keywords:

Crowdsourcing, Microtasking, NER

Abstract

This paper examines the importance of presenting simple, intuitive tasks when conducting microtasking on crowdsourcing platforms. Most crowdsourcing platforms allow the maker of a task to present any length of instructions to crowd workers who participate in their tasks. Our experiments show, however, most workers who participate in crowdsourcing microtasks do not read the instructions, even when they are very brief. To facilitate success in microtask design, we highlight the importance of making simple, easy to grasp tasks that do not rely on instructions for explanation.

Downloads

Published

2016-03-28

How to Cite

Rothwell, S., Carter, S., Elshenawy, A., & Braga, D. (2016). Job Complexity and User Attention in Crowdsourcing Microtasks. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 3(1), 20-25. https://doi.org/10.1609/hcomp.v3i1.13265

Issue

Section

Crowdsourcing Breakthroughs for Language Technology Applications Workshop