On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length

Stanislaw Jastrzebski, Zachary Kenton, Nicolas Ballas, Asja Fischer, Yoshua Bengio, Amos J. Storkey. On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net, 2019. [doi]

Abstract

Abstract is missing.