Relay knowledge distillation for efficiently boosting the performance of shallow networks

Shipeng Fu, Zhibing Lai, Yulun Zhang, Yiguang Liu, Xiaomin Yang. Relay knowledge distillation for efficiently boosting the performance of shallow networks. Neurocomputing, 514:512-525, 2022. [doi]

Abstract

Abstract is missing.