Haoyuan Wu, Haisheng Zheng, Zhuolun He, Bei Yu 0001. Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks. In Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen, editors, Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024. pages 737-749, Association for Computational Linguistics, 2024. [doi]
Abstract is missing.