Chongyang Gao, Kezhen Chen, Jinmeng Rao, Ruibo Liu, Baochen Sun, Yawen Zhang, Daiyi Peng, Xiaoyuan Guo, V. S. Subrahmanian. MoLA: MoE LoRA with Layer-wise Expert Allocation. In Luis Chiruzzo, Alan Ritter, Lu Wang, editors, Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico, USA, April 29 - May 4, 2025. pages 5097-5112, Association for Computational Linguistics, 2025. [doi]
Abstract is missing.