Mixture-of-Clustered-Experts: Advancing Expert Specialization and Generalization in Instruction Tuning

Sugyeong Eo, Jung-Jun Lee, Chanjun Park, HeuiSeok Lim. Mixture-of-Clustered-Experts: Advancing Expert Specialization and Generalization in Instruction Tuning. In Christos Christodoulopoulos 0001, Tanmoy Chakraborty 0002, Carolyn Rose, Violet Peng, editors, Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, EMNLP 2025, Suzhou, China, November 4-9, 2025. pages 14201-14212, Association for Computational Linguistics, 2025. [doi]

Abstract

Abstract is missing.