Is Automated Topic Model Evaluation Broken? The Incoherence of Coherence

Alexander Miserlis Hoyle, Pranav Goel, Andrew Hian-Cheong, Denis Peskov, Jordan L. Boyd-Graber, Philip Resnik. Is Automated Topic Model Evaluation Broken? The Incoherence of Coherence. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 2018-2033, 2021. [doi]

@inproceedings{HoyleGHPBR21,
  title = {Is Automated Topic Model Evaluation Broken? The Incoherence of Coherence},
  author = {Alexander Miserlis Hoyle and Pranav Goel and Andrew Hian-Cheong and Denis Peskov and Jordan L. Boyd-Graber and Philip Resnik},
  year = {2021},
  url = {https://proceedings.neurips.cc/paper/2021/hash/0f83556a305d789b1d71815e8ea4f4b0-Abstract.html},
  researchr = {https://researchr.org/publication/HoyleGHPBR21},
  cites = {0},
  citedby = {0},
  pages = {2018-2033},
  booktitle = {Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual},
  editor = {Marc'Aurelio Ranzato and Alina Beygelzimer and Yann N. Dauphin and Percy Liang and Jennifer Wortman Vaughan},
}