Fold3D: Rethinking and Parallelizing Computational and Communicational Tasks in the Training of Large DNN Models

Fanxin Li, Shixiong Zhao, Yuhao Qing, Xusheng Chen, Xiuxian Guan, Sen Wang, Gong Zhang, Heming Cui. Fold3D: Rethinking and Parallelizing Computational and Communicational Tasks in the Training of Large DNN Models. IEEE Trans. Parallel Distrib. Syst., 34(5):1432-1449, May 2023. [doi]

Authors

Fanxin Li

This author has not been identified. Look up 'Fanxin Li' in Google

Shixiong Zhao

This author has not been identified. Look up 'Shixiong Zhao' in Google

Yuhao Qing

This author has not been identified. Look up 'Yuhao Qing' in Google

Xusheng Chen

This author has not been identified. Look up 'Xusheng Chen' in Google

Xiuxian Guan

This author has not been identified. Look up 'Xiuxian Guan' in Google

Sen Wang

This author has not been identified. Look up 'Sen Wang' in Google

Gong Zhang

This author has not been identified. Look up 'Gong Zhang' in Google

Heming Cui

This author has not been identified. Look up 'Heming Cui' in Google