Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation

Khouloud Saadi, Jelena Mitrovic, Michael Granitzer. Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023. pages 13235-13245, Association for Computational Linguistics, 2023. [doi]

Abstract

Abstract is missing.