Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study

Zhiqiang Shen, Zechun Liu, Dejia Xu, Zitian Chen, Kwang-Ting Cheng, Marios Savvides. Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. [doi]

@inproceedings{ShenLXCCS21,
  title = {Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study},
  author = {Zhiqiang Shen and Zechun Liu and Dejia Xu and Zitian Chen and Kwang-Ting Cheng and Marios Savvides},
  year = {2021},
  url = {https://openreview.net/forum?id=PObuuGVrGaZ},
  researchr = {https://researchr.org/publication/ShenLXCCS21},
  cites = {0},
  citedby = {0},
  booktitle = {9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021},
  publisher = {OpenReview.net},
}