Ziyang Luo, Yadong Xi, Jing Ma, Zhiwei Yang, Xiaoxi Mao, Changjie Fan, Rongsheng Zhang. DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks. In Marine Carpuat, Marie-Catherine de Marneffe, Iván Vladimir Meza Ruíz, editors, Findings of the Association for Computational Linguistics: NAACL 2022, Seattle, WA, United States, July 10-15, 2022. pages 1185-1197, Association for Computational Linguistics, 2022. [doi]
Abstract is missing.