Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD

Sanghamitra Dutta, Gauri Joshi, Soumyadip Ghosh, Parijat Dube, Priya Nagpurkar. Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD. In Amos J. Storkey, Fernando PĂ©rez-Cruz, editors, International Conference on Artificial Intelligence and Statistics, AISTATS 2018, 9-11 April 2018, Playa Blanca, Lanzarote, Canary Islands, Spain. Volume 84 of Proceedings of Machine Learning Research, pages 803-812, PMLR, 2018. [doi]

Authors

Sanghamitra Dutta

This author has not been identified. Look up 'Sanghamitra Dutta' in Google

Gauri Joshi

This author has not been identified. Look up 'Gauri Joshi' in Google

Soumyadip Ghosh

This author has not been identified. Look up 'Soumyadip Ghosh' in Google

Parijat Dube

This author has not been identified. Look up 'Parijat Dube' in Google

Priya Nagpurkar

This author has not been identified. Look up 'Priya Nagpurkar' in Google