Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference

Bang An, Jie Lyu 0004, Zhenyi Wang, Chunyuan Li, Changwei Hu, Fei Tan, Ruiyi Zhang, Yifan Hu, Changyou Chen. Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 236-255, Association for Computational Linguistics, 2020. [doi]

@inproceedings{AnLWLHTZHC20,
  title = {Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference},
  author = {Bang An and Jie Lyu 0004 and Zhenyi Wang and Chunyuan Li and Changwei Hu and Fei Tan and Ruiyi Zhang and Yifan Hu and Changyou Chen},
  year = {2020},
  url = {https://www.aclweb.org/anthology/2020.emnlp-main.17/},
  researchr = {https://researchr.org/publication/AnLWLHTZHC20},
  cites = {0},
  citedby = {0},
  pages = {236-255},
  booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020},
  editor = {Bonnie Webber and Trevor Cohn and Yulan He and Yang Liu},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-952148-60-6},
}