Knowledge Distillation from Bert in Pre-Training and Fine-Tuning for Polyphone Disambiguation

Hao Sun, Xu Tan, Jun-Wei Gan, Sheng Zhao, Dongxu Han, Hongzhi Liu, Tao Qin, Tie-Yan Liu. Knowledge Distillation from Bert in Pre-Training and Fine-Tuning for Polyphone Disambiguation. In IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2019, Singapore, December 14-18, 2019. pages 168-175, IEEE, 2019. [doi]

Abstract

Abstract is missing.