Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model

Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George E. Dahl, Christopher J. Shallue, Roger B. Grosse. Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model. In Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alché-Buc, Edward A. Fox, Roman Garnett, editors, Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, 8-14 December 2019, Vancouver, BC, Canada. pages 8194-8205, 2019. [doi]

Authors

Guodong Zhang

This author has not been identified. Look up 'Guodong Zhang' in Google

Lala Li

This author has not been identified. Look up 'Lala Li' in Google

Zachary Nado

This author has not been identified. Look up 'Zachary Nado' in Google

James Martens

This author has not been identified. Look up 'James Martens' in Google

Sushant Sachdeva

This author has not been identified. Look up 'Sushant Sachdeva' in Google

George E. Dahl

This author has not been identified. Look up 'George E. Dahl' in Google

Christopher J. Shallue

This author has not been identified. Look up 'Christopher J. Shallue' in Google

Roger B. Grosse

This author has not been identified. Look up 'Roger B. Grosse' in Google