Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, Noah A. Smith. NarrowBERT: Accelerating Masked Language Model Pretraining and Inference. In Anna Rogers, Jordan L. Boyd-Graber, Naoaki Okazaki, editors, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2023, Toronto, Canada, July 9-14, 2023. pages 1723-1730, Association for Computational Linguistics, 2023. [doi]
Abstract is missing.