Classification of Heads in Multi-head Attention Mechanisms

Feihu Huang, Min Jiang, Fang Liu, Dian Xu, Zimeng Fan, Yonghao Wang. Classification of Heads in Multi-head Attention Mechanisms. In GĂ©rard Memmi, Baijian Yang, Linghe Kong, Tianwei Zhang 0004, Meikang Qiu, editors, Knowledge Science, Engineering and Management - 15th International Conference, KSEM 2022, Singapore, August 6-8, 2022, Proceedings, Part III. Volume 13370 of Lecture Notes in Computer Science, pages 681-692, Springer, 2022. [doi]

Abstract

Abstract is missing.