Checco, A., Roitero, K., Maddalena, E., Mizzaro, S. and Demartini, G. 2017. Let’s Agree to Disagree: Fixing Agreement Measures for Crowdsourcing. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 5, 1 (Sep. 2017), 11-20. DOI:https://doi.org/10.1609/hcomp.v5i1.13306.