Mixture of Heterogeneous Grouped Experts for Language Modeling

ZhiCheng Ma, Xiang Liu, Zhaoxiang Liu, Ning Wang, Yi Shen, Kai Wang 0012, Shuming Shi, Shiguo Lian. Mixture of Heterogeneous Grouped Experts for Language Modeling. In Yunyao Li 0001, Georg Rehm, Mei Tu, editors, Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track), ACL 2026, San Diego, California, USA, July 2-7, 2026. pages 308-317, Association for Computational Linguistics, 2026. [doi]

Abstract

Abstract is missing.