Ameet Deshpande, Karthik Narasimhan. Guiding Attention for Self-Supervised Learning with Transformers. In Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, EMNLP 2020, Online Event, 16-20 November 2020. pages 4676-4686, Association for Computational Linguistics, 2020. [doi]
Abstract is missing.