Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum

Kirby Banman, Liam Peet-Pare, Nidhi Hegde 0001, Alona Fyshe, Martha White. Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. [doi]

Authors

Kirby Banman

This author has not been identified. Look up 'Kirby Banman' in Google

Liam Peet-Pare

This author has not been identified. Look up 'Liam Peet-Pare' in Google

Nidhi Hegde 0001

This author has not been identified. Look up 'Nidhi Hegde 0001' in Google

Alona Fyshe

This author has not been identified. Look up 'Alona Fyshe' in Google

Martha White

This author has not been identified. Look up 'Martha White' in Google