What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation

Gabriele Merlin, Vedant Nanda, Ruchit Rawal, Mariya Toneva. What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation. In Sarath Chandar, Razvan Pascanu, Hanie Sedghi, Doina Precup, editors, Conference on Lifelong Learning Agents, 22-25 August 2023, McGill University, Montréal, Québec, Canada. Volume 232 of Proceedings of Machine Learning Research, pages 601-619, PMLR, 2023. [doi]

@inproceedings{MerlinNRT23,
  title = {What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation},
  author = {Gabriele Merlin and Vedant Nanda and Ruchit Rawal and Mariya Toneva},
  year = {2023},
  url = {https://proceedings.mlr.press/v232/merlin23a.html},
  researchr = {https://researchr.org/publication/MerlinNRT23},
  cites = {0},
  citedby = {0},
  pages = {601-619},
  booktitle = {Conference on Lifelong Learning Agents, 22-25 August 2023, McGill University, Montréal, Québec, Canada},
  editor = {Sarath Chandar and Razvan Pascanu and Hanie Sedghi and Doina Precup},
  volume = {232},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
}