On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay

Ekaterina Lobacheva, Maxim Kodryan, Nadezhda Chirkova, Andrey Malinin, Dmitry P. Vetrov. On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 21545-21556, 2021. [doi]

Authors

Ekaterina Lobacheva

This author has not been identified. Look up 'Ekaterina Lobacheva' in Google

Maxim Kodryan

This author has not been identified. Look up 'Maxim Kodryan' in Google

Nadezhda Chirkova

This author has not been identified. Look up 'Nadezhda Chirkova' in Google

Andrey Malinin

This author has not been identified. Look up 'Andrey Malinin' in Google

Dmitry P. Vetrov

This author has not been identified. Look up 'Dmitry P. Vetrov' in Google