A Loss Curvature Perspective on Training Instabilities of Deep Learning Models

Justin Gilmer, Behrooz Ghorbani, Ankush Garg, Sneha Kudugunta, Behnam Neyshabur, David Cardoze, George Edward Dahl, Zachary Nado, Orhan Firat. A Loss Curvature Perspective on Training Instabilities of Deep Learning Models. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. [doi]

@inproceedings{GilmerGGKNCDNF22,
  title = {A Loss Curvature Perspective on Training Instabilities of Deep Learning Models},
  author = {Justin Gilmer and Behrooz Ghorbani and Ankush Garg and Sneha Kudugunta and Behnam Neyshabur and David Cardoze and George Edward Dahl and Zachary Nado and Orhan Firat},
  year = {2022},
  url = {https://openreview.net/forum?id=OcKMT-36vUs},
  researchr = {https://researchr.org/publication/GilmerGGKNCDNF22},
  cites = {0},
  citedby = {0},
  booktitle = {The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022},
  publisher = {OpenReview.net},
}