Checco, Alessandro, et al. “Let’s Agree to Disagree: Fixing Agreement Measures for Crowdsourcing”. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, vol. 5, no. 1, Sept. 2017, pp. 11-20, doi:10.1609/hcomp.v5i1.13306.