Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model

Xiao Wang, Weikang Zhou, Qi Zhang, Jie Zhou, Songyang Gao, Junzhe Wang, Menghan Zhang, Xiang Gao, Yunwen Chen, Tao Gui. Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model. In Anna Rogers, Jordan L. Boyd-Graber, Naoaki Okazaki, editors, Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023. pages 555-568, Association for Computational Linguistics, 2023. [doi]

@inproceedings{WangZZZGWZGCG23,
  title = {Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model},
  author = {Xiao Wang and Weikang Zhou and Qi Zhang and Jie Zhou and Songyang Gao and Junzhe Wang and Menghan Zhang and Xiang Gao and Yunwen Chen and Tao Gui},
  year = {2023},
  url = {https://aclanthology.org/2023.findings-acl.35},
  researchr = {https://researchr.org/publication/WangZZZGWZGCG23},
  cites = {0},
  citedby = {0},
  pages = {555-568},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023},
  editor = {Anna Rogers and Jordan L. Boyd-Graber and Naoaki Okazaki},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-959429-62-3},
}