Knowledge Fusion Distillation: Improving Distillation with Multi-scale Attention Mechanisms

Linfeng Li, Weixing Su, Fang Liu, Maowei He, Xiaodan Liang. Knowledge Fusion Distillation: Improving Distillation with Multi-scale Attention Mechanisms. Neural Processing Letters, 55(5):6165-6180, October 2023. [doi]

Abstract

Abstract is missing.