Classification of Heads in Multi-head Attention Mechanisms

Feihu Huang, Min Jiang, Fang Liu, Dian Xu, Zimeng Fan, Yonghao Wang. Classification of Heads in Multi-head Attention Mechanisms. In Gérard Memmi, Baijian Yang, Linghe Kong, Tianwei Zhang 0004, Meikang Qiu, editors, Knowledge Science, Engineering and Management - 15th International Conference, KSEM 2022, Singapore, August 6-8, 2022, Proceedings, Part III. Volume 13370 of Lecture Notes in Computer Science, pages 681-692, Springer, 2022. [doi]

@inproceedings{HuangJLXFW22,
  title = {Classification of Heads in Multi-head Attention Mechanisms},
  author = {Feihu Huang and Min Jiang and Fang Liu and Dian Xu and Zimeng Fan and Yonghao Wang},
  year = {2022},
  doi = {10.1007/978-3-031-10989-8_54},
  url = {https://doi.org/10.1007/978-3-031-10989-8_54},
  researchr = {https://researchr.org/publication/HuangJLXFW22},
  cites = {0},
  citedby = {0},
  pages = {681-692},
  booktitle = {Knowledge Science, Engineering and Management - 15th International Conference, KSEM 2022, Singapore, August 6-8, 2022, Proceedings, Part III},
  editor = {Gérard Memmi and Baijian Yang and Linghe Kong and Tianwei Zhang 0004 and Meikang Qiu},
  volume = {13370},
  series = {Lecture Notes in Computer Science},
  publisher = {Springer},
  isbn = {978-3-031-10989-8},
}