Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT

Jing Zhao, Yifan Wang, Junwei Bao 0001, Youzheng Wu, Xiaodong He 0002. Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT. In Smaranda Muresan, Preslav Nakov, Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. pages 4811-4820, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.