Ruosi Wan, Zhanxing Zhu, Xiangyu Zhang 0005, Jian Sun 0001. Spherical Motion Dynamics: Learning Dynamics of Normalized Neural Network using SGD and Weight Decay. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 6380-6391, 2021. [doi]
Abstract is missing.