Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum

Kirby Banman, Liam Peet-Pare, Nidhi Hegde 0001, Alona Fyshe, Martha White. Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. [doi]

@inproceedings{BanmanP0FW22,
  title = {Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum},
  author = {Kirby Banman and Liam Peet-Pare and Nidhi Hegde 0001 and Alona Fyshe and Martha White},
  year = {2022},
  url = {https://openreview.net/forum?id=5ECQL05ub0J},
  researchr = {https://researchr.org/publication/BanmanP0FW22},
  cites = {0},
  citedby = {0},
  booktitle = {The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022},
  publisher = {OpenReview.net},
}