Yixuan Su, Fangyu Liu 0001, Zaiqiao Meng, Tian Lan, Lei Shu, Ehsan Shareghi, Nigel Collier. TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning. In Marine Carpuat, Marie-Catherine de Marneffe, Iván Vladimir Meza Ruíz, editors, Findings of the Association for Computational Linguistics: NAACL 2022, Seattle, WA, United States, July 10-15, 2022. pages 2497-2507, Association for Computational Linguistics, 2022. [doi]
Abstract is missing.