Mechanism Design for Crowdsourcing Markets with Heterogeneous Tasks

Authors

  • Gagan Goel Google, New York
  • Afshin Nikzad Stanford University
  • Adish Singla ETH Zurich

Keywords:

Crowdsourcing, mechanism design, matching constraints, incentive compatibility, procurement auctions, heterogeneous tasks

Abstract

Designing optimal pricing policies and mechanisms for allocating tasks to workers is central to online crowdsourcing markets. In this paper, we consider the following realistic setting of online crowdsourcing markets -- we are given a set of heterogeneous tasks requiring certain skills; each worker has certain expertise and interests which define the set of tasks she is interested in and willing to do. Given this bipartite graph between workers and tasks, we design our mechanism \truthuniform which does the allocation of tasks to workers, while ensuring budget feasibility, incentive-compatibility and achieves near-optimal utility. We further extend our results by exploiting a link with online Adwords allocation problem and present a randomized mechanism \truthfractional with improved approximation guarantees. Apart from strong theoretical guarantees, we carry out extensive experimentation using simulations as well as on a realistic case study of Wikipedia translation project with Mechanical Turk workers. Our results demonstrate the practical applicability of our mechanisms for realistic crowdsourcing markets on the web.

Downloads

Published

2014-09-05

How to Cite

Goel, G., Nikzad, A., & Singla, A. (2014). Mechanism Design for Crowdsourcing Markets with Heterogeneous Tasks. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 2(1). Retrieved from https://ojs.aaai.org/index.php/HCOMP/article/view/13158