Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs

Shaohuai Shi, Qiang Wang, Xiaowen Chu, Bo Li, Yang Qin, Ruihao Liu, Xinxiao Zhao. Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs. In 39th IEEE Conference on Computer Communications, INFOCOM 2020, Toronto, ON, Canada, July 6-9, 2020. pages 406-415, IEEE, 2020. [doi]

@inproceedings{ShiWCLQLZ20,
  title = {Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs},
  author = {Shaohuai Shi and Qiang Wang and Xiaowen Chu and Bo Li and Yang Qin and Ruihao Liu and Xinxiao Zhao},
  year = {2020},
  doi = {10.1109/INFOCOM41043.2020.9155269},
  url = {https://doi.org/10.1109/INFOCOM41043.2020.9155269},
  researchr = {https://researchr.org/publication/ShiWCLQLZ20},
  cites = {0},
  citedby = {0},
  pages = {406-415},
  booktitle = {39th IEEE Conference on Computer Communications, INFOCOM 2020, Toronto, ON, Canada, July 6-9, 2020},
  publisher = {IEEE},
  isbn = {978-1-7281-6412-0},
}