Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization

Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen. Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. pages 6524-6538, Association for Computational Linguistics, 2021. [doi]

@inproceedings{LiangZCJLHZC20,
  title = {Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization},
  author = {Chen Liang and Simiao Zuo and Minshuo Chen and Haoming Jiang and Xiaodong Liu and Pengcheng He and Tuo Zhao and Weizhu Chen},
  year = {2021},
  url = {https://aclanthology.org/2021.acl-long.510},
  researchr = {https://researchr.org/publication/LiangZCJLHZC20},
  cites = {0},
  citedby = {0},
  pages = {6524-6538},
  booktitle = {Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021},
  editor = {Chengqing Zong and Fei Xia and Wenjie Li 0002 and Roberto Navigli},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-954085-52-7},
}