Utility is in the Eye of the User: A Critique of NLP Leaderboards

Kawin Ethayarajh, Dan Jurafsky. Utility is in the Eye of the User: A Critique of NLP Leaderboards. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 4846-4853, Association for Computational Linguistics, 2020. [doi]

Abstract

Abstract is missing.