How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?

Sergey Pletenev, Maria Marina, Daniil Moskovskiy, Vasily Konovalov, Pavel Braslavski 0001, Alexander Panchenko, Mikhail Salnikov. How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?. In Luis Chiruzzo, Alan Ritter, Lu Wang, editors, Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico, USA, April 29 - May 4, 2025. pages 4309-4322, Association for Computational Linguistics, 2025. [doi]

Authors

Sergey Pletenev

This author has not been identified. Look up 'Sergey Pletenev' in Google

Maria Marina

This author has not been identified. Look up 'Maria Marina' in Google

Daniil Moskovskiy

This author has not been identified. Look up 'Daniil Moskovskiy' in Google

Vasily Konovalov

This author has not been identified. Look up 'Vasily Konovalov' in Google

Pavel Braslavski 0001

This author has not been identified. Look up 'Pavel Braslavski 0001' in Google

Alexander Panchenko

This author has not been identified. Look up 'Alexander Panchenko' in Google

Mikhail Salnikov

This author has not been identified. Look up 'Mikhail Salnikov' in Google