FreezePipe: An Efficient Dynamic Pipeline Parallel Approach Based on Freezing Mechanism for Distributed DNN Training

Caishan Weng, Zhiyang Shu, Zhengjia Xu, Jinghui Zhang, Junzhou Luo, Fang Dong 0001, Peng Wang, Zhengang Wang. FreezePipe: An Efficient Dynamic Pipeline Parallel Approach Based on Freezing Mechanism for Distributed DNN Training. In Weiming Shen 0001, Jean-Paul A. Barthès, Junzhou Luo, Adriana S. Vivacqua, Daniel Schneider 0008, Cheng Xie, Jinghui Zhang, Haibin Zhu, Kunkun Peng, Claudia Lage Rebello da Motta, editors, 26th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2023, Rio de Janeiro, Brazil, May 24-26, 2023. pages 303-308, IEEE, 2023. [doi]

Authors

Caishan Weng

This author has not been identified. Look up 'Caishan Weng' in Google

Zhiyang Shu

This author has not been identified. Look up 'Zhiyang Shu' in Google

Zhengjia Xu

This author has not been identified. Look up 'Zhengjia Xu' in Google

Jinghui Zhang

This author has not been identified. Look up 'Jinghui Zhang' in Google

Junzhou Luo

This author has not been identified. Look up 'Junzhou Luo' in Google

Fang Dong 0001

This author has not been identified. Look up 'Fang Dong 0001' in Google

Peng Wang

This author has not been identified. Look up 'Peng Wang' in Google

Zhengang Wang

This author has not been identified. Look up 'Zhengang Wang' in Google