Checco, A.; Roitero, K.; Maddalena, E.; Mizzaro, S.; Demartini, G. Let’s Agree to Disagree: Fixing Agreement Measures for Crowdsourcing. HCOMP 2017, 5, 11-20.