The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models

Satya Sai Srinath Namburi, Makesh Sreedhar, Srinath Srinivasan, Frederic Sala. The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023. pages 5255-5273, Association for Computational Linguistics, 2023. [doi]

Abstract

Abstract is missing.