The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry

Tomohiro Hayase, Ryo Karakida. The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry. In Arindam Banerjee 0001, Kenji Fukumizu, editors, The 24th International Conference on Artificial Intelligence and Statistics, AISTATS 2021, April 13-15, 2021, Virtual Event. Volume 130 of Proceedings of Machine Learning Research, pages 334-342, PMLR, 2021. [doi]

Abstract

Abstract is missing.