PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation

Lianshang Cai, Linhao Zhang, Dehong Ma, Jun Fan, Daiting Shi, Yi Wu, Zhicong Cheng, Simiu Gu, Dawei Yin. PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation. In Yunyao Li, Angeliki Lazaridou, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: EMNLP 2022 - Industry Track, Abu Dhabi, UAE, December 7 - 11, 2022. pages 587-595, Association for Computational Linguistics, 2022. [doi]

Authors

Lianshang Cai

This author has not been identified. Look up 'Lianshang Cai' in Google

Linhao Zhang

This author has not been identified. Look up 'Linhao Zhang' in Google

Dehong Ma

This author has not been identified. Look up 'Dehong Ma' in Google

Jun Fan

This author has not been identified. Look up 'Jun Fan' in Google

Daiting Shi

This author has not been identified. Look up 'Daiting Shi' in Google

Yi Wu

This author has not been identified. Look up 'Yi Wu' in Google

Zhicong Cheng

This author has not been identified. Look up 'Zhicong Cheng' in Google

Simiu Gu

This author has not been identified. Look up 'Simiu Gu' in Google

Dawei Yin

This author has not been identified. Look up 'Dawei Yin' in Google