Utility is in the Eye of the User: A Critique of NLP Leaderboards

Kawin Ethayarajh, Dan Jurafsky. Utility is in the Eye of the User: A Critique of NLP Leaderboards. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 4846-4853, Association for Computational Linguistics, 2020. [doi]

@inproceedings{EthayarajhJ20,
  title = {Utility is in the Eye of the User: A Critique of NLP Leaderboards},
  author = {Kawin Ethayarajh and Dan Jurafsky},
  year = {2020},
  url = {https://www.aclweb.org/anthology/2020.emnlp-main.393/},
  researchr = {https://researchr.org/publication/EthayarajhJ20},
  cites = {0},
  citedby = {0},
  pages = {4846-4853},
  booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020},
  editor = {Bonnie Webber and Trevor Cohn and Yulan He and Yang Liu},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-952148-60-6},
}