Using Anonymity and Communal Efforts to Improve Quality of Crowdsourced Feedback

Authors

  • Julie Hui Northwestern University
  • Amos Glenn Carnegie Mellon University
  • Rachel Jue Carnegie Mellon University
  • Elizabeth Gerber Northwestern University
  • Steven Dow Carnegie Mellon University

DOI:

https://doi.org/10.1609/hcomp.v3i1.13229

Keywords:

crowdsourcing, social media, social networks, feedback, classroom

Abstract

Student entrepreneurs struggle to collect feedback on their product pitches in a classroom setting due to a lack of time, money, and access to motivated feedback providers. Online social networks present a unique opportunity for entrepreneurial students to quickly access feedback providers by leveraging their online social capital. In order to better understand how to improve crowdsourced online pitch feedback, we perform an experiment to test the effect of online anonymity on pitch feedback quality and quantity. We also test a communal feedback method—evenly distributing between teams feedback providers from the class’s collective online social networks—which would help all teams benefit from a useful amount of feedback rather than having some teams receive much more feedback than others. We found that feedback providers in the anonymous condition provided significantly more specific criticism and specific praise, which students rated as more useful. Furthermore, we found that the communal feedback method helped all teams receive sufficient feedback to edit their pitches. This research contributes an empirical investigation to the crowdsourcing community of how crowds through online social networks can help student entrepreneurs obtain authentic feedback to improve their work.

Downloads

Published

2015-09-23

How to Cite

Hui, J., Glenn, A., Jue, R., Gerber, E., & Dow, S. (2015). Using Anonymity and Communal Efforts to Improve Quality of Crowdsourced Feedback. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 3(1), 72-82. https://doi.org/10.1609/hcomp.v3i1.13229