Personalized Human Computation


  • Peter Organisciak University of Illinois at Urbana-Champaign
  • Jaime Teevan Microsoft Research
  • Susan Dumais Microsoft Research
  • Robert Miller MIT CSAIL
  • Adam Kalai Microsoft Research



human computation, personalization


Significant effort in machine learning and information retrieval has been devoted to identifying personalized content such as recommendations and search results. Personalized human computation has the potential to go beyond existing techniques like collaborative filtering to provide personal­ized results on demand, over personal data, and for complex tasks. This work-in-progress compares two approaches to personal­ized human computation. In both, users annotate a small set of training examples which are then used by the crowd to annotate unseen items. In the first approach, which we call taste-matching, crowd members are asked to annotate the same set of training examples, and the ratings of similar users on other items are then used to infer personal­ized ratings. In the second approach, taste-grokking, the crowd is presented with the training examples and asked to use them predict the ratings of the target user on other items.




How to Cite

Organisciak, P., Teevan, J., Dumais, S., Miller, R., & Kalai, A. (2013). Personalized Human Computation. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 1(1), 56-57.