Cooperative Two-Dimensional Hierarchical All-Reduce for Large Language Model Training with Heterogeneous Communication Links

Xiangming Zhu 0001, Shanyun Liu, Jingfei Chang, Hongyang Chen 0001. Cooperative Two-Dimensional Hierarchical All-Reduce for Large Language Model Training with Heterogeneous Communication Links. In 101st IEEE Vehicular Technology Conference, VTC Spring 2025, Oslo, Norway, June 17-20, 2025. pages 1-7, IEEE, 2025. [doi]

Abstract

Abstract is missing.