Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs

Shaohuai Shi, Qiang Wang, Xiaowen Chu, Bo Li, Yang Qin, Ruihao Liu, Xinxiao Zhao. Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs. In 39th IEEE Conference on Computer Communications, INFOCOM 2020, Toronto, ON, Canada, July 6-9, 2020. pages 406-415, IEEE, 2020. [doi]

Abstract

Abstract is missing.