Minibatch vs Local SGD for Heterogeneous Distributed Learning - researchr publication related

researchr

You are not signed in
Sign in
Sign up

Blake E. Woodworth, Kumar Kshitij Patel, Nati Srebro. Minibatch vs Local SGD for Heterogeneous Distributed Learning. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual. 2020. [doi]

The following publications are possibly variants of this publication:

Is Local SGD Better than Minibatch SGD?Blake E. Woodworth, Kumar Kshitij Patel, Sebastian U. Stich, Zhen Dai, Brian Bullins, H. Brendan McMahan, Ohad Shamir, Nathan Srebro. icml 2020: 10334-10343 [doi]

Asynchronous SGD Beats Minibatch SGD Under Arbitrary DelaysKonstantin Mishchenko, Francis R. Bach, Mathieu Even, Blake E. Woodworth. nips 2022: [doi]

runs on WebDSL