Developing a Loss Prediction-based Asynchronous Stochastic Gradient Descent Algorithm for Distributed Training of Deep Neural Networks

Junyu Li, Ligang He, Shenyuan Ren, Rui Mao. Developing a Loss Prediction-based Asynchronous Stochastic Gradient Descent Algorithm for Distributed Training of Deep Neural Networks. In José Nelson Amaral, Lizy Kurian John, Xipeng Shen, editors, ICPP 2020: 49th International Conference on Parallel Processing, Edmonton, AB, Canada, August 17-20, 2020. ACM, 2020. [doi]

Abstract

Abstract is missing.