Wojciech Tarnowski, Piotr Warchol, Stanislaw Jastrzebski, Jacek Tabor, Maciej A. Nowak. Dynamical Isometry is Achieved in Residual Networks in a Universal Way for any Activation Function. In Kamalika Chaudhuri, Masashi Sugiyama, editors, The 22nd International Conference on Artificial Intelligence and Statistics, AISTATS 2019, 16-18 April 2019, Naha, Okinawa, Japan. Volume 89 of Proceedings of Machine Learning Research, pages 2221-2230, PMLR, 2019. [doi]
Abstract is missing.