Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent

Jaehoon Lee, Lechao Xiao, Samuel S. Schoenholz, Yasaman Bahri, Roman Novak, Jascha Sohl-Dickstein, Jeffrey Pennington. Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent. In Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alché-Buc, Edward A. Fox, Roman Garnett, editors, Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, 8-14 December 2019, Vancouver, BC, Canada. pages 8570-8581, 2019. [doi]

Authors

Jaehoon Lee

This author has not been identified. Look up 'Jaehoon Lee' in Google

Lechao Xiao

This author has not been identified. Look up 'Lechao Xiao' in Google

Samuel S. Schoenholz

This author has not been identified. Look up 'Samuel S. Schoenholz' in Google

Yasaman Bahri

This author has not been identified. Look up 'Yasaman Bahri' in Google

Roman Novak

This author has not been identified. Look up 'Roman Novak' in Google

Jascha Sohl-Dickstein

This author has not been identified. Look up 'Jascha Sohl-Dickstein' in Google

Jeffrey Pennington

This author has not been identified. Look up 'Jeffrey Pennington' in Google