POSPAN: Position-Constrained Span Masking for Language Model Pre-training

Zhenyu Zhang, Lei Shen, Yuming Zhao, Meng Chen 0006, Xiaodong He 0001. POSPAN: Position-Constrained Span Masking for Language Model Pre-training. In Ingo Frommholz, Frank Hopfgartner, Mark Lee 0001, Michael Oakes 0001, Mounia Lalmas, Min Zhang 0006, Rodrygo L. T. Santos, editors, Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, CIKM 2023, Birmingham, United Kingdom, October 21-25, 2023. pages 4420-4424, ACM, 2023. [doi]

Abstract

Abstract is missing.