Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu 0001, Shuohang Wang, Siqi Sun, Hao Cheng 0002, Xiaodong Liu 0003, Jianfeng Gao, Pengcheng He, Michael Zeng 0001, Xuedong Huang 0001. Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. In Luc De Raedt, editor, Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria, 23-29 July 2022. pages 2762-2768, ijcai.org, 2022. [doi]

Abstract

Abstract is missing.