Sparse is Enough in Fine-tuning Pre-trained Large Language Models

Weixi Song, Zuchao Li, Lefei Zhang, Hai Zhao 0001, Bo Du 0001. Sparse is Enough in Fine-tuning Pre-trained Large Language Models. In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net, 2024. [doi]

@inproceedings{SongLZ0024,
  title = {Sparse is Enough in Fine-tuning Pre-trained Large Language Models},
  author = {Weixi Song and Zuchao Li and Lefei Zhang and Hai Zhao 0001 and Bo Du 0001},
  year = {2024},
  url = {https://openreview.net/forum?id=10hu2D3hAg},
  researchr = {https://researchr.org/publication/SongLZ0024},
  cites = {0},
  citedby = {0},
  booktitle = {Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024},
  publisher = {OpenReview.net},
}