A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks

Shaohuai Shi, Qiang Wang, Kaiyong Zhao, Zhenheng Tang, Yuxin Wang, Xiang Huang, Xiaowen Chu. A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks. In 39th IEEE International Conference on Distributed Computing Systems, ICDCS 2019, Dallas, TX, USA, July 7-10, 2019. pages 2238-2247, IEEE, 2019. [doi]

Authors

Shaohuai Shi

This author has not been identified. Look up 'Shaohuai Shi' in Google

Qiang Wang

This author has not been identified. Look up 'Qiang Wang' in Google

Kaiyong Zhao

This author has not been identified. Look up 'Kaiyong Zhao' in Google

Zhenheng Tang

This author has not been identified. Look up 'Zhenheng Tang' in Google

Yuxin Wang

This author has not been identified. Look up 'Yuxin Wang' in Google

Xiang Huang

This author has not been identified. Look up 'Xiang Huang' in Google

Xiaowen Chu

This author has not been identified. Look up 'Xiaowen Chu' in Google