SparseGrad: A Selective Method for Efficient Fine-tuning of MLP Layers

Viktoria Chekalina, Anna Rudenko, Gleb Mezentsev, Aleksandr Mikhalev, Alexander Panchenko, Ivan V. Oseledets. SparseGrad: A Selective Method for Efficient Fine-tuning of MLP Layers. In Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen, editors, Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024. pages 14929-14939, Association for Computational Linguistics, 2024. [doi]

Abstract

Abstract is missing.