How does the pre-training objective affect what large language models learn about linguistic properties?

Ahmed Alajrami, Nikolaos Aletras. How does the pre-training objective affect what large language models learn about linguistic properties?. In Smaranda Muresan, Preslav Nakov, Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. pages 131-147, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.