Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation

Bowen Wu, Huan Zhang, Mengyuan Li, Zongsheng Wang, Qihang Feng, Junhong Huang, Baoxun Wang. Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation. In Kam-Fai Wong, Kevin Knight, Hua Wu, editors, Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2020, Suzhou, China, December 4-7, 2020. pages 70-79, Association for Computational Linguistics, 2020. [doi]

Authors

Bowen Wu

This author has not been identified. Look up 'Bowen Wu' in Google

Huan Zhang

This author has not been identified. Look up 'Huan Zhang' in Google

Mengyuan Li

This author has not been identified. Look up 'Mengyuan Li' in Google

Zongsheng Wang

This author has not been identified. Look up 'Zongsheng Wang' in Google

Qihang Feng

This author has not been identified. Look up 'Qihang Feng' in Google

Junhong Huang

This author has not been identified. Look up 'Junhong Huang' in Google

Baoxun Wang

This author has not been identified. Look up 'Baoxun Wang' in Google