Yimeng Wu, Peyman Passban, Mehdi Rezagholizadeh, Qun Liu. Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 1016-1021, Association for Computational Linguistics, 2020. [doi]
Abstract is missing.