EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets

Xiaohan Chen, Yu Cheng 0001, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu. EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. pages 2195-2207, Association for Computational Linguistics, 2021. [doi]

@inproceedings{ChenCWGWL20,
  title = {EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets},
  author = {Xiaohan Chen and Yu Cheng 0001 and Shuohang Wang and Zhe Gan and Zhangyang Wang and Jingjing Liu},
  year = {2021},
  url = {https://aclanthology.org/2021.acl-long.171},
  researchr = {https://researchr.org/publication/ChenCWGWL20},
  cites = {0},
  citedby = {0},
  pages = {2195-2207},
  booktitle = {Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021},
  editor = {Chengqing Zong and Fei Xia and Wenjie Li 0002 and Roberto Navigli},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-954085-52-7},
}