Is Local SGD Better than Minibatch SGD?

Blake E. Woodworth, Kumar Kshitij Patel, Sebastian U. Stich, Zhen Dai, Brian Bullins, H. Brendan McMahan, Ohad Shamir, Nathan Srebro. Is Local SGD Better than Minibatch SGD?. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event. Volume 119 of Proceedings of Machine Learning Research, pages 10334-10343, PMLR, 2020. [doi]

Abstract

Abstract is missing.