O(1) Communication for Distributed SGD through Two-Level Gradient Averaging

Subhadeep Bhattacharya, Weikuan Yu, Fahim Tahmid Chowdhury, Kathryn Mohror. O(1) Communication for Distributed SGD through Two-Level Gradient Averaging. In IEEE International Conference on Cluster Computing, CLUSTER 2021, Portland, OR, USA, September 7-10, 2021. pages 332-343, IEEE, 2021. [doi]

@inproceedings{BhattacharyaYCM21,
  title = {O(1) Communication for Distributed SGD through Two-Level Gradient Averaging},
  author = {Subhadeep Bhattacharya and Weikuan Yu and Fahim Tahmid Chowdhury and Kathryn Mohror},
  year = {2021},
  doi = {10.1109/Cluster48925.2021.00054},
  url = {https://doi.org/10.1109/Cluster48925.2021.00054},
  researchr = {https://researchr.org/publication/BhattacharyaYCM21},
  cites = {0},
  citedby = {0},
  pages = {332-343},
  booktitle = {IEEE International Conference on Cluster Computing, CLUSTER 2021, Portland, OR, USA, September 7-10, 2021},
  publisher = {IEEE},
  isbn = {978-1-7281-9666-4},
}