Ka Wong, Praveen K. Paritosh. k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations. In Smaranda Muresan, Preslav Nakov, Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. pages 378-384, Association for Computational Linguistics, 2022. [doi]
Abstract is missing.