Simeng Sun, Brian Dillon, Mohit Iyyer. How Much Do Modifications to Transformer Language Models Affect Their Ability to Learn Linguistic Knowledge?. In Shabnam Tafreshi, João Sedoc, Anna Rogers, Aleksandr Drozd, Anna Rumshisky, Arjun R. Akula, editors, Proceedings of the Third Workshop on Insights from Negative Results in NLP, Insights@ACL 2022, Dublin, Ireland, May 26, 2022. pages 46-53, Association for Computational Linguistics, 2022. [doi]
Abstract is missing.