Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions

Kiwon Lee, Andrew N. Cheng, Elliot Paquette, Courtney Paquette. Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions. In Sanmi Koyejo, S. Mohamed, A. Agarwal, Danielle Belgrave, K. Cho, A. Oh, editors, Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022. 2022. [doi]

Authors

Kiwon Lee

This author has not been identified. Look up 'Kiwon Lee' in Google

Andrew N. Cheng

This author has not been identified. Look up 'Andrew N. Cheng' in Google

Elliot Paquette

This author has not been identified. Look up 'Elliot Paquette' in Google

Courtney Paquette

This author has not been identified. Look up 'Courtney Paquette' in Google