How fine can fine-tuning be? Learning efficient language models

Evani Radiya-Dixit, Xin Wang. How fine can fine-tuning be? Learning efficient language models. In Silvia Chiappa, Roberto Calandra, editors, The 23rd International Conference on Artificial Intelligence and Statistics, AISTATS 2020, 26-28 August 2020, Online [Palermo, Sicily, Italy]. Volume 108 of Proceedings of Machine Learning Research, pages 2435-2443, PMLR, 2020. [doi]

@inproceedings{Radiya-DixitW20,
  title = {How fine can fine-tuning be? Learning efficient language models},
  author = {Evani Radiya-Dixit and Xin Wang},
  year = {2020},
  url = {http://proceedings.mlr.press/v108/radiya-dixit20a.html},
  researchr = {https://researchr.org/publication/Radiya-DixitW20},
  cites = {0},
  citedby = {0},
  pages = {2435-2443},
  booktitle = {The 23rd International Conference on Artificial Intelligence and Statistics, AISTATS 2020, 26-28 August 2020, Online [Palermo, Sicily, Italy]},
  editor = {Silvia Chiappa and Roberto Calandra},
  volume = {108},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
}