Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs

Shaohuai Shi, Qiang Wang, Xiaowen Chu, Bo Li, Yang Qin, Ruihao Liu, Xinxiao Zhao. Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs. In 39th IEEE Conference on Computer Communications, INFOCOM 2020, Toronto, ON, Canada, July 6-9, 2020. pages 406-415, IEEE, 2020. [doi]

Authors

Shaohuai Shi

This author has not been identified. Look up 'Shaohuai Shi' in Google

Qiang Wang

This author has not been identified. Look up 'Qiang Wang' in Google

Xiaowen Chu

This author has not been identified. Look up 'Xiaowen Chu' in Google

Bo Li

This author has not been identified. Look up 'Bo Li' in Google

Yang Qin

This author has not been identified. Look up 'Yang Qin' in Google

Ruihao Liu

This author has not been identified. Look up 'Ruihao Liu' in Google

Xinxiao Zhao

This author has not been identified. Look up 'Xinxiao Zhao' in Google