Elastic Averaging for Efficient Pipelined DNN Training

Zihao Chen, Chen Xu 0001, Weining Qian, Aoying Zhou. Elastic Averaging for Efficient Pipelined DNN Training. In Maryam Mehri Dehnavi, Milind Kulkarni 0001, Sriram Krishnamoorthy, editors, Proceedings of the 28th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, PPoPP 2023, Montreal, QC, Canada, 25 February 2023 - 1 March 2023. pages 380-391, ACM, 2023. [doi]

Abstract

Abstract is missing.