BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Elad Ben Zaken, Yoav Goldberg, Shauli Ravfogel. BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models. In Smaranda Muresan, Preslav Nakov, Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. pages 1-9, Association for Computational Linguistics, 2022. [doi]

@inproceedings{ZakenGR22,
  title = {BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models},
  author = {Elad Ben Zaken and Yoav Goldberg and Shauli Ravfogel},
  year = {2022},
  url = {https://aclanthology.org/2022.acl-short.1},
  researchr = {https://researchr.org/publication/ZakenGR22},
  cites = {0},
  citedby = {0},
  pages = {1-9},
  booktitle = {Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022},
  editor = {Smaranda Muresan and Preslav Nakov and Aline Villavicencio},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-955917-22-3},
}