Regularizing Transformer-based Acoustic Models by Penalizing Attention Weights

Mun-Hak Lee, Joon-Hyuk Chang, Sang-Eon Lee, Ju-Seok Seong, Chanhee Park, Haeyoung Kwon. Regularizing Transformer-based Acoustic Models by Penalizing Attention Weights. In Hanseok Ko, John H. L. Hansen, editors, Interspeech 2022, 23rd Annual Conference of the International Speech Communication Association, Incheon, Korea, 18-22 September 2022. pages 56-60, ISCA, 2022. [doi]

Abstract

Abstract is missing.