Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference

Bang An, Jie Lyu 0004, Zhenyi Wang, Chunyuan Li, Changwei Hu, Fei Tan, Ruiyi Zhang, Yifan Hu, Changyou Chen. Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 236-255, Association for Computational Linguistics, 2020. [doi]

Authors

Bang An

This author has not been identified. Look up 'Bang An' in Google

Jie Lyu 0004

This author has not been identified. Look up 'Jie Lyu 0004' in Google

Zhenyi Wang

This author has not been identified. Look up 'Zhenyi Wang' in Google

Chunyuan Li

This author has not been identified. Look up 'Chunyuan Li' in Google

Changwei Hu

This author has not been identified. Look up 'Changwei Hu' in Google

Fei Tan

This author has not been identified. Look up 'Fei Tan' in Google

Ruiyi Zhang

This author has not been identified. Look up 'Ruiyi Zhang' in Google

Yifan Hu

This author has not been identified. Look up 'Yifan Hu' in Google

Changyou Chen

This author has not been identified. Look up 'Changyou Chen' in Google