Peng Xu, Dhruv Kumar 0005, Wei Yang, Wenjie Zi, Keyi Tang, Chenyang Huang 0001, Jackie Chi Kit Cheung, Simon J. D. Prince, Yanshuai Cao. Optimizing Deeper Transformers on Small Datasets. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. pages 2089-2102, Association for Computational Linguistics, 2021. [doi]
Abstract is missing.