On the Overlooked Pitfalls of Weight Decay and How to Mitigate Them: A Gradient-Norm Perspective - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Zeke Xie, Zhiqiang Xu, Jingzhao Zhang, Issei Sato, Masashi Sugiyama. On the Overlooked Pitfalls of Weight Decay and How to Mitigate Them: A Gradient-Norm Perspective. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

This author has not been identified. Look up 'Zeke Xie' in GoogleThis author has not been identified. Look up 'Zhiqiang Xu' in GoogleThis author has not been identified. Look up 'Jingzhao Zhang' in GoogleThis author has not been identified. Look up 'Issei Sato' in GoogleThis author has not been identified. Look up 'Masashi Sugiyama' in Google

runs on WebDSL