k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations

Ka Wong, Praveen K. Paritosh. k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations. In Smaranda Muresan, Preslav Nakov, Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. pages 378-384, Association for Computational Linguistics, 2022. [doi]

Authors

Ka Wong

This author has not been identified. Look up 'Ka Wong' in Google

Praveen K. Paritosh

This author has not been identified. Look up 'Praveen K. Paritosh' in Google