Zachary Ankner, Naomi Saphra, Davis W. Blalock, Jonathan Frankle, Matthew L. Leavitt. Dynamic Masking Rate Schedules for MLM Pretraining. In Yvette Graham, Matthew Purver, editors, Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2024 - Volume 2: Short Papers, St. Julian's, Malta, March 17-22, 2024. pages 477-487, Association for Computational Linguistics, 2024. [doi]
Abstract is missing.