CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model

Kaiyan Zhang, Ning Ding, Biqing Qi, Xuekai Zhu, Xinwei Long, Bowen Zhou. CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023. pages 9612-9637, Association for Computational Linguistics, 2023. [doi]

@inproceedings{ZhangDQZLZ23,
  title = {CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model},
  author = {Kaiyan Zhang and Ning Ding and Biqing Qi and Xuekai Zhu and Xinwei Long and Bowen Zhou},
  year = {2023},
  url = {https://aclanthology.org/2023.emnlp-main.597},
  researchr = {https://researchr.org/publication/ZhangDQZLZ23},
  cites = {0},
  citedby = {0},
  pages = {9612-9637},
  booktitle = {Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023},
  editor = {Houda Bouamor and Juan Pino 0001 and Kalika Bali},
  publisher = {Association for Computational Linguistics},
  isbn = {979-8-89176-060-8},
}