LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding

Hao Fu, Shaojun Zhou, Qihong Yang, Junjie Tang, Guiquan Liu, Kaikui Liu, Xiaolong Li. LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021. pages 12830-12838, AAAI Press, 2021. [doi]

Authors

Hao Fu

This author has not been identified. Look up 'Hao Fu' in Google

Shaojun Zhou

This author has not been identified. Look up 'Shaojun Zhou' in Google

Qihong Yang

This author has not been identified. Look up 'Qihong Yang' in Google

Junjie Tang

This author has not been identified. Look up 'Junjie Tang' in Google

Guiquan Liu

This author has not been identified. Look up 'Guiquan Liu' in Google

Kaikui Liu

This author has not been identified. Look up 'Kaikui Liu' in Google

Xiaolong Li

This author has not been identified. Look up 'Xiaolong Li' in Google