Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning. Pre-Training Transformers as Energy-Based Cloze Models. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 285-294, Association for Computational Linguistics, 2020. [doi]
Abstract is missing.