A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks

Shaohuai Shi, Qiang Wang, Kaiyong Zhao, Zhenheng Tang, Yuxin Wang, Xiang Huang, Xiaowen Chu. A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks. In 39th IEEE International Conference on Distributed Computing Systems, ICDCS 2019, Dallas, TX, USA, July 7-10, 2019. pages 2238-2247, IEEE, 2019. [doi]

@inproceedings{ShiWZTWHC19,
  title = {A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks},
  author = {Shaohuai Shi and Qiang Wang and Kaiyong Zhao and Zhenheng Tang and Yuxin Wang and Xiang Huang and Xiaowen Chu},
  year = {2019},
  doi = {10.1109/ICDCS.2019.00220},
  url = {https://doi.org/10.1109/ICDCS.2019.00220},
  researchr = {https://researchr.org/publication/ShiWZTWHC19},
  cites = {0},
  citedby = {0},
  pages = {2238-2247},
  booktitle = {39th IEEE International Conference on Distributed Computing Systems, ICDCS 2019, Dallas, TX, USA, July 7-10, 2019},
  publisher = {IEEE},
  isbn = {978-1-7281-2519-0},
}