A Memory-Efficient Hybrid Parallel Framework for Deep Neural Network Training

Dongsheng Li 0001, Shengwei Li, Zhiquan Lai, Yongquan Fu, Xiangyu Ye, Lei Cai, Linbo Qiao. A Memory-Efficient Hybrid Parallel Framework for Deep Neural Network Training. IEEE Trans. Parallel Distrib. Syst., 35(4):577-591, April 2024. [doi]

Abstract

Abstract is missing.