PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation

Lianshang Cai, Linhao Zhang, Dehong Ma, Jun Fan, Daiting Shi, Yi Wu, Zhicong Cheng, Simiu Gu, Dawei Yin. PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation. In Yunyao Li, Angeliki Lazaridou, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: EMNLP 2022 - Industry Track, Abu Dhabi, UAE, December 7 - 11, 2022. pages 587-595, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.