Rethinking Skip Connection with Layer Normalization

Fenglin Liu, Xuancheng Ren, Zhiyuan Zhang, Xu Sun 0001, Yuexian Zou. Rethinking Skip Connection with Layer Normalization. In Donia Scott, NĂºria Bel, Chengqing Zong, editors, Proceedings of the 28th International Conference on Computational Linguistics, COLING 2020, Barcelona, Spain (Online), December 8-13, 2020. pages 3586-3598, International Committee on Computational Linguistics, 2020. [doi]

Abstract

Abstract is missing.