Jianyu Wang, Vinayak Tantia, Nicolas Ballas, Michael Rabbat. SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net, 2020. [doi]
Abstract is missing.