BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics

Liang Ma, Shuyang Cao, Robert L. Logan IV, Di Lu, Shihao Ran, Ke Zhang, Joel R. Tetreault, Alejandro Jaimes. BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics. In Anna Rogers, Jordan L. Boyd-Graber, Naoaki Okazaki, editors, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023. pages 12788-12812, Association for Computational Linguistics, 2023. [doi]

@inproceedings{MaCLLRZTJ23,
  title = {BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics},
  author = {Liang Ma and Shuyang Cao and Robert L. Logan IV and Di Lu and Shihao Ran and Ke Zhang and Joel R. Tetreault and Alejandro Jaimes},
  year = {2023},
  url = {https://aclanthology.org/2023.acl-long.716},
  researchr = {https://researchr.org/publication/MaCLLRZTJ23},
  cites = {0},
  citedby = {0},
  pages = {12788-12812},
  booktitle = {Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023},
  editor = {Anna Rogers and Jordan L. Boyd-Graber and Naoaki Okazaki},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-959429-72-2},
}