Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice

Jeffrey Pennington, Samuel S. Schoenholz, Surya Ganguli. Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, CA, USA. pages 4788-4798, 2017. [doi]

Authors

Jeffrey Pennington

This author has not been identified. Look up 'Jeffrey Pennington' in Google

Samuel S. Schoenholz

This author has not been identified. Look up 'Samuel S. Schoenholz' in Google

Surya Ganguli

This author has not been identified. Look up 'Surya Ganguli' in Google