Why RELU Units Sometimes Die: Analysis of Single-Unit Error Backpropagation in Neural Networks

Scott C. Douglas, Jiutian Yu. Why RELU Units Sometimes Die: Analysis of Single-Unit Error Backpropagation in Neural Networks. In Michael B. Matthews, editor, 52nd Asilomar Conference on Signals, Systems, and Computers, ACSSC 2018, Pacific Grove, CA, USA, October 28-31, 2018. pages 864-868, IEEE, 2018. [doi]

Abstract

Abstract is missing.