How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?

Sergey Pletenev, Maria Marina, Daniil Moskovskiy, Vasily Konovalov, Pavel Braslavski 0001, Alexander Panchenko, Mikhail Salnikov. How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?. In Luis Chiruzzo, Alan Ritter, Lu Wang, editors, Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico, USA, April 29 - May 4, 2025. pages 4309-4322, Association for Computational Linguistics, 2025. [doi]

Abstract

Abstract is missing.