Beyond Signal Propagation: Is Feature Diversity Necessary in Deep Neural Network Initialization?

Yaniv Blumenfeld, Dar Gilboa, Daniel Soudry. Beyond Signal Propagation: Is Feature Diversity Necessary in Deep Neural Network Initialization?. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event. Volume 119 of Proceedings of Machine Learning Research, pages 960-969, PMLR, 2020. [doi]

Abstract

Abstract is missing.