HSP: Hybrid Synchronous Parallelism for Fast Distributed Deep Learning

Yijun Li, Jiawei Huang 0001, Zhaoyi Li, Shengwen Zhou, Wanchun Jiang, Jianxin Wang 0001. HSP: Hybrid Synchronous Parallelism for Fast Distributed Deep Learning. In Proceedings of the 51st International Conference on Parallel Processing, ICPP 2022, Bordeaux, France, 29 August 2022 - 1 September 2022. ACM, 2022. [doi]

Abstract

Abstract is missing.