David Cheng-Han Chiang, Sung-Feng Huang, Hung-yi Lee. Pretrained Language Model Embryology: The Birth of ALBERT. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 6813-6828, Association for Computational Linguistics, 2020. [doi]
Abstract is missing.