Ran Yang, Chunhua Deng. Surpass Teacher: Enlightenment Structured Knowledge Distillation of Transformer. In IEEE International Conference on Systems, Man, and Cybernetics, SMC 2023, Honolulu, Oahu, HI, USA, October 1-4, 2023. pages 5102-5107, IEEE, 2023. [doi]
Abstract is missing.