HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training - researchr publication related

researchr

You are not signed in
Sign in
Sign up

Yabo Duan, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Peng Liang, Dongsheng Li. HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training. In IEEE International Conference on Cluster Computing, CLUSTER 2022, Heidelberg, Germany, September 5-8, 2022. pages 313-323, IEEE, 2022. [doi]

The following publications are possibly variants of this publication:

Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid ParallelismTailing Yuan, Yuliang Liu, Xucheng Ye, Shenglong Zhang, Jianchao Tan, Bin Chen, Chengru Song, Di Zhang. usenix 2024: 545-561 [doi]

runs on WebDSL