Bridging Information-Theoretic and Geometric Compression in Language Models

Emily Cheng, Corentin Kervadec, Marco Baroni. Bridging Information-Theoretic and Geometric Compression in Language Models. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023. pages 12397-12420, Association for Computational Linguistics, 2023. [doi]

Abstract

Abstract is missing.