Accelerating Distributed Deep Learning Training with Compression Assisted Allgather and Reduce-Scatter Communication

Qinghua Zhou, Quentin Anthony, Lang Xu, Aamir Shafi, Mustafa Abduljabbar, Hari Subramoni, Dhabaleswar K. Panda 0001. Accelerating Distributed Deep Learning Training with Compression Assisted Allgather and Reduce-Scatter Communication. In IEEE International Parallel and Distributed Processing Symposium, IPDPS 2023, St. Petersburg, FL, USA, May 15-19, 2023. pages 134-144, IEEE, 2023. [doi]

Abstract

Abstract is missing.