O(1) Communication for Distributed SGD through Two-Level Gradient Averaging

Subhadeep Bhattacharya, Weikuan Yu, Fahim Tahmid Chowdhury, Kathryn Mohror. O(1) Communication for Distributed SGD through Two-Level Gradient Averaging. In IEEE International Conference on Cluster Computing, CLUSTER 2021, Portland, OR, USA, September 7-10, 2021. pages 332-343, IEEE, 2021. [doi]

Authors

Subhadeep Bhattacharya

This author has not been identified. Look up 'Subhadeep Bhattacharya' in Google

Weikuan Yu

This author has not been identified. Look up 'Weikuan Yu' in Google

Fahim Tahmid Chowdhury

This author has not been identified. Look up 'Fahim Tahmid Chowdhury' in Google

Kathryn Mohror

This author has not been identified. Look up 'Kathryn Mohror' in Google