NarrowBERT: Accelerating Masked Language Model Pretraining and Inference

Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, Noah A. Smith. NarrowBERT: Accelerating Masked Language Model Pretraining and Inference. In Anna Rogers, Jordan L. Boyd-Graber, Naoaki Okazaki, editors, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2023, Toronto, Canada, July 9-14, 2023. pages 1723-1730, Association for Computational Linguistics, 2023. [doi]

@inproceedings{LiKCKS23,
  title = {NarrowBERT: Accelerating Masked Language Model Pretraining and Inference},
  author = {Haoxin Li and Phillip Keung and Daniel Cheng and Jungo Kasai and Noah A. Smith},
  year = {2023},
  url = {https://aclanthology.org/2023.acl-short.146},
  researchr = {https://researchr.org/publication/LiKCKS23},
  cites = {0},
  citedby = {0},
  pages = {1723-1730},
  booktitle = {Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2023, Toronto, Canada, July 9-14, 2023},
  editor = {Anna Rogers and Jordan L. Boyd-Graber and Naoaki Okazaki},
  publisher = {Association for Computational Linguistics},
}