H-AT: Hybrid Attention Transfer for Knowledge Distillation

Yan Qu, Weihong Deng, Jiani Hu. H-AT: Hybrid Attention Transfer for Knowledge Distillation. In Yuxin Peng, Qingshan Liu 0001, Huchuan Lu 0001, Zhenan Sun, Chenglin Liu, Xilin Chen, Hongbin Zha, Jian Yang 0003, editors, Pattern Recognition and Computer Vision - Third Chinese Conference, PRCV 2020, Nanjing, China, October 16-18, 2020, Proceedings, Part III. Volume 12307 of Lecture Notes in Computer Science, pages 249-260, Springer, 2020. [doi]

Abstract

Abstract is missing.