Knowledge Distillation from Bert in Pre-Training and Fine-Tuning for Polyphone Disambiguation

Hao Sun, Xu Tan, Jun-Wei Gan, Sheng Zhao, Dongxu Han, Hongzhi Liu, Tao Qin, Tie-Yan Liu. Knowledge Distillation from Bert in Pre-Training and Fine-Tuning for Polyphone Disambiguation. In IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2019, Singapore, December 14-18, 2019. pages 168-175, IEEE, 2019. [doi]

Authors

Hao Sun

This author has not been identified. Look up 'Hao Sun' in Google

Xu Tan

This author has not been identified. Look up 'Xu Tan' in Google

Jun-Wei Gan

This author has not been identified. Look up 'Jun-Wei Gan' in Google

Sheng Zhao

This author has not been identified. Look up 'Sheng Zhao' in Google

Dongxu Han

This author has not been identified. Look up 'Dongxu Han' in Google

Hongzhi Liu

This author has not been identified. Look up 'Hongzhi Liu' in Google

Tao Qin

This author has not been identified. Look up 'Tao Qin' in Google

Tie-Yan Liu

This author has not been identified. Look up 'Tie-Yan Liu' in Google