Insights into the mechanism behind reusing Teacher's classifier in Knowledge Distillation

Kinshuk Dua. Insights into the mechanism behind reusing Teacher's classifier in Knowledge Distillation. In Krystal Maughan, Rosanne Liu, Thomas F. Burns, editors, The First Tiny Papers Track at ICLR 2023, Tiny Papers @ ICLR 2023, Kigali, Rwanda, May 5, 2023. OpenReview.net, 2023. [doi]

References

No references recorded for this publication.

Cited by

No citations of this publication recorded.