FreezePipe: An Efficient Dynamic Pipeline Parallel Approach Based on Freezing Mechanism for Distributed DNN Training

Caishan Weng, Zhiyang Shu, Zhengjia Xu, Jinghui Zhang, Junzhou Luo, Fang Dong 0001, Peng Wang, Zhengang Wang. FreezePipe: An Efficient Dynamic Pipeline Parallel Approach Based on Freezing Mechanism for Distributed DNN Training. In Weiming Shen 0001, Jean-Paul A. Barthès, Junzhou Luo, Adriana S. Vivacqua, Daniel Schneider 0008, Cheng Xie, Jinghui Zhang, Haibin Zhu, Kunkun Peng, Claudia Lage Rebello da Motta, editors, 26th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2023, Rio de Janeiro, Brazil, May 24-26, 2023. pages 303-308, IEEE, 2023. [doi]

Abstract

Abstract is missing.