Thomas Bachlechner, Bodhisattwa Prasad Majumder, Huanru Henry Mao, Gary Cottrell, Julian McAuley. ReZero is all you need: fast convergence at large depth. In Cassio P. de Campos, Marloes H. Maathuis, Erik Quaeghebeur, editors, Proceedings of the Thirty-Seventh Conference on Uncertainty in Artificial Intelligence, UAI 2021, Virtual Event, 27-30 July 2021. Volume 161 of Proceedings of Machine Learning Research, pages 1352-1361, AUAI Press, 2021. [doi]
Abstract is missing.