Enlivening Redundant Heads in Multi-head Self-attention for Machine Translation

Tianfu Zhang, Heyan Huang, Chong Feng, Longbing Cao. Enlivening Redundant Heads in Multi-head Self-attention for Machine Translation. In Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih, editors, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. pages 3238-3248, Association for Computational Linguistics, 2021. [doi]

Authors

Tianfu Zhang

This author has not been identified. Look up 'Tianfu Zhang' in Google

Heyan Huang

This author has not been identified. Look up 'Heyan Huang' in Google

Chong Feng

This author has not been identified. Look up 'Chong Feng' in Google

Longbing Cao

This author has not been identified. Look up 'Longbing Cao' in Google