Compressing Transformer-Based ASR Model by Task-Driven Loss and Attention-Based Multi-Level Feature Distillation

Yongjie Lv, Longbiao Wang, Meng Ge, Sheng Li 0010, Chenchen Ding, Lixin Pan, Yuguang Wang, Jianwu Dang, Kiyoshi Honda. Compressing Transformer-Based ASR Model by Task-Driven Loss and Attention-Based Multi-Level Feature Distillation. In IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2022, Virtual and Singapore, 23-27 May 2022. pages 7992-7996, IEEE, 2022. [doi]

Authors

Yongjie Lv

This author has not been identified. Look up 'Yongjie Lv' in Google

Longbiao Wang

This author has not been identified. Look up 'Longbiao Wang' in Google

Meng Ge

This author has not been identified. Look up 'Meng Ge' in Google

Sheng Li 0010

This author has not been identified. Look up 'Sheng Li 0010' in Google

Chenchen Ding

This author has not been identified. Look up 'Chenchen Ding' in Google

Lixin Pan

This author has not been identified. Look up 'Lixin Pan' in Google

Yuguang Wang

This author has not been identified. Look up 'Yuguang Wang' in Google

Jianwu Dang

This author has not been identified. Look up 'Jianwu Dang' in Google

Kiyoshi Honda

This author has not been identified. Look up 'Kiyoshi Honda' in Google