Exploring the Limits of Model Compression in LLMs: A Knowledge Distillation Study on QA Tasks

Joyeeta Datta, Niclas Doll, Qusai Ramadan, Zeyd Boukhers. Exploring the Limits of Model Compression in LLMs: A Knowledge Distillation Study on QA Tasks. In Frédéric Béchet, Fabrice Lefèvre, Nicholas Asher, Seokhwan Kim, Téva Merlin, editors, Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2025, Avignon, France, August 25-26, 2025. pages 477-483, Association for Computational Linguistics, 2025. [doi]

Abstract

Abstract is missing.