Can We Use Probing to Better Understand Fine-Tuning and Knowledge Distillation of the BERT NLU?

Jakub Hoscilowicz, Marcin Sowanski, Piotr Czubowski, Artur Janicki. Can We Use Probing to Better Understand Fine-Tuning and Knowledge Distillation of the BERT NLU?. In Ana Paula Rocha 0001, Luc Steels, H. Jaap van den Herik, editors, Proceedings of the 15th International Conference on Agents and Artificial Intelligence, ICAART 2023, Volume 3, Lisbon, Portugal, February 22-24, 2023. pages 625-632, SCITEPRESS, 2023. [doi]

@inproceedings{HoscilowiczSCJ23,
  title = {Can We Use Probing to Better Understand Fine-Tuning and Knowledge Distillation of the BERT NLU?},
  author = {Jakub Hoscilowicz and Marcin Sowanski and Piotr Czubowski and Artur Janicki},
  year = {2023},
  doi = {10.5220/0011724900003393},
  url = {https://doi.org/10.5220/0011724900003393},
  researchr = {https://researchr.org/publication/HoscilowiczSCJ23},
  cites = {0},
  citedby = {0},
  pages = {625-632},
  booktitle = {Proceedings of the 15th International Conference on Agents and Artificial Intelligence, ICAART 2023, Volume 3, Lisbon, Portugal, February 22-24, 2023},
  editor = {Ana Paula Rocha 0001 and Luc Steels and H. Jaap van den Herik},
  publisher = {SCITEPRESS},
  isbn = {978-989-758-623-1},
}