Assessors Agreement: A Case Study Across Assessor Type, Payment Levels, Query Variations and Relevance Dimensions

João R. M. Palotti, Guido Zuccon, Johannes Bernhardt-Melischnig, Allan Hanbury, Lorraine Goeuriot. Assessors Agreement: A Case Study Across Assessor Type, Payment Levels, Query Variations and Relevance Dimensions. In Norbert Fuhr, Paulo Quaresma, Teresa Gonçalves, Birger Larsen, Krisztian Balog, Craig Macdonald, Linda Cappellato, Nicola Ferro, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Évora, Portugal, September 5-8, 2016, Proceedings. Volume 9822 of Lecture Notes in Computer Science, pages 40-53, Springer, 2016. [doi]

Abstract

Abstract is missing.