Checco, A. et al. 2017. Let’s Agree to Disagree: Fixing Agreement Measures for Crowdsourcing. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 5, 1 (Sep. 2017), 11–20. DOI:https://doi.org/10.1609/hcomp.v5i1.13306.