Hippie: A Data-Paralleled Pipeline Approach to Improve Memory-Efficiency and Scalability for Large DNN Training

Xiangyu Ye, Zhiquan Lai, Shengwei Li, Lei Cai, Ding Sun, Linbo Qiao, Dongsheng Li. Hippie: A Data-Paralleled Pipeline Approach to Improve Memory-Efficiency and Scalability for Large DNN Training. In Xian-He Sun, Sameer Shende, Laxmikant V. Kalé, Yong Chen 0001, editors, ICPP 2021: 50th International Conference on Parallel Processing, Lemont, IL, USA, August 9 - 12, 2021. ACM, 2021. [doi]

Authors

Xiangyu Ye

This author has not been identified. Look up 'Xiangyu Ye' in Google

Zhiquan Lai

This author has not been identified. Look up 'Zhiquan Lai' in Google

Shengwei Li

This author has not been identified. Look up 'Shengwei Li' in Google

Lei Cai

This author has not been identified. Look up 'Lei Cai' in Google

Ding Sun

This author has not been identified. Look up 'Ding Sun' in Google

Linbo Qiao

This author has not been identified. Look up 'Linbo Qiao' in Google

Dongsheng Li

This author has not been identified. Look up 'Dongsheng Li' in Google