Better Estimation of the Kullback-Leibler Divergence Between Language Models

Afra Amini, Tim Vieira, Ryan Cotterell. Better Estimation of the Kullback-Leibler Divergence Between Language Models. In Danielle Belgrave, Cheng Zhang 0005, Laura N. Montoya, Hsuan-Tien Lin, Razvan Pascanu, Piotr Koniusz, Marzyeh Ghassemi, Nancy Chen, Iván Vladimir Meza Ruíz, Arturo Loaiza-Bonilla, editors, Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, NeurIPS 2025, San Diago, CA, USA, December 2-7, 2025 / Mexico City, Mexico, November 30 - December 5, 2025. 2025. [doi]

@inproceedings{AminiVC25,
  title = {Better Estimation of the Kullback-Leibler Divergence Between Language Models},
  author = {Afra Amini and Tim Vieira and Ryan Cotterell},
  year = {2025},
  url = {http://papers.nips.cc/paper_files/paper/2025/hash/a2e9be3d64bcc196731d0a4e0e2c33ae-Abstract-Conference.html},
  researchr = {https://researchr.org/publication/AminiVC25},
  cites = {0},
  citedby = {0},
  booktitle = {Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, NeurIPS 2025, San Diago, CA, USA, December 2-7, 2025 / Mexico City, Mexico, November 30 - December 5, 2025},
  editor = {Danielle Belgrave and Cheng Zhang 0005 and Laura N. Montoya and Hsuan-Tien Lin and Razvan Pascanu and Piotr Koniusz and Marzyeh Ghassemi and Nancy Chen and Iván Vladimir Meza Ruíz and Arturo Loaiza-Bonilla},
}