Insights into the mechanism behind reusing Teacher's classifier in Knowledge Distillation

Kinshuk Dua. Insights into the mechanism behind reusing Teacher's classifier in Knowledge Distillation. In Krystal Maughan, Rosanne Liu, Thomas F. Burns, editors, The First Tiny Papers Track at ICLR 2023, Tiny Papers @ ICLR 2023, Kigali, Rwanda, May 5, 2023. OpenReview.net, 2023. [doi]

@inproceedings{Dua23,
  title = {Insights into the mechanism behind reusing Teacher's classifier in Knowledge Distillation},
  author = {Kinshuk Dua},
  year = {2023},
  url = {https://openreview.net/pdf?id=_cL7Uj4LXAJ},
  researchr = {https://researchr.org/publication/Dua23},
  cites = {0},
  citedby = {0},
  booktitle = {The First Tiny Papers Track at ICLR 2023, Tiny Papers @ ICLR 2023, Kigali, Rwanda, May 5, 2023},
  editor = {Krystal Maughan and Rosanne Liu and Thomas F. Burns},
  publisher = {OpenReview.net},
}