Emergent Modularity in Pre-trained Transformers

Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Chaojun Xiao, Xiaozhi Wang, Xu Han 0007, Zhiyuan Liu 0001, Ruobing Xie, Maosong Sun, Jie Zhou 0016. Emergent Modularity in Pre-trained Transformers. In Anna Rogers, Jordan L. Boyd-Graber, Naoaki Okazaki, editors, Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023. pages 4066-4083, Association for Computational Linguistics, 2023. [doi]

@inproceedings{ZhangZLXW00XS023,
  title = {Emergent Modularity in Pre-trained Transformers},
  author = {Zhengyan Zhang and Zhiyuan Zeng and Yankai Lin and Chaojun Xiao and Xiaozhi Wang and Xu Han 0007 and Zhiyuan Liu 0001 and Ruobing Xie and Maosong Sun and Jie Zhou 0016},
  year = {2023},
  url = {https://aclanthology.org/2023.findings-acl.250},
  researchr = {https://researchr.org/publication/ZhangZLXW00XS023},
  cites = {0},
  citedby = {0},
  pages = {4066-4083},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023},
  editor = {Anna Rogers and Jordan L. Boyd-Graber and Naoaki Okazaki},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-959429-62-3},
}