Rethinking Soft Labels for Knowledge Distillation: A Bias-Variance Tradeoff Perspective

Helong Zhou, Liangchen Song, Jiajie Chen, Ye Zhou, Guoli Wang, Junsong Yuan, Qian Zhang. Rethinking Soft Labels for Knowledge Distillation: A Bias-Variance Tradeoff Perspective. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. [doi]

Authors

Helong Zhou

This author has not been identified. Look up 'Helong Zhou' in Google

Liangchen Song

This author has not been identified. Look up 'Liangchen Song' in Google

Jiajie Chen

This author has not been identified. Look up 'Jiajie Chen' in Google

Ye Zhou

This author has not been identified. Look up 'Ye Zhou' in Google

Guoli Wang

This author has not been identified. Look up 'Guoli Wang' in Google

Junsong Yuan

This author has not been identified. Look up 'Junsong Yuan' in Google

Qian Zhang

This author has not been identified. Look up 'Qian Zhang' in Google