The AI Bookie — Place Your Bets: Will Machine Learning Outgrow Human Labeling?


  • Mike Schaekermann University of Waterloo
  • Christopher Homan University of Rochester
  • Lora Aroyo Google Research
  • Praveen Paritosh Goold Research
  • Kurt Bollacker The Long Now Foundation
  • Chris Welty Google Research



The AI Bookie column documents highlights from AI Bets, an online forum for the creation of adjudicatable predictions and bets about the future of artificial intelligence. Although it is easy to make a prediction about the future, this forum was created to help researchers craft predictions whose accuracy can be clearly and unambiguously judged when a prediction comes due. The bets will be documented online and regularly in this publication in The AI Bookie. We encourage bets that are rigorously and scientifically argued. We discourage bets that are too general to be evaluated or too specific to an institution or individual. The goal is not to continue to feed the media frenzy and pundit predictions about artificial intelligence, but rather to curate and promote bets whose outcomes will provide useful feedback to the scientific community. Place your bets! Please go to




How to Cite

Schaekermann, M., Homan, C. ., Aroyo, L. ., Paritosh, P. ., Bollacker, K. ., & Welty, C. (2020). The AI Bookie — Place Your Bets: Will Machine Learning Outgrow Human Labeling?. AI Magazine, 41(4), 123-126.