Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study

Zhiqiang Shen, Zechun Liu, Dejia Xu, Zitian Chen, Kwang-Ting Cheng, Marios Savvides. Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. [doi]

Authors

Zhiqiang Shen

This author has not been identified. Look up 'Zhiqiang Shen' in Google

Zechun Liu

This author has not been identified. Look up 'Zechun Liu' in Google

Dejia Xu

This author has not been identified. Look up 'Dejia Xu' in Google

Zitian Chen

This author has not been identified. Look up 'Zitian Chen' in Google

Kwang-Ting Cheng

This author has not been identified. Look up 'Kwang-Ting Cheng' in Google

Marios Savvides

This author has not been identified. Look up 'Marios Savvides' in Google