Stepwise Masking: A Masking Strategy Based on Stepwise Regression for Pre-training

Jie Pan, Shuxia Ren, Dongzhang Rao, Zongxian Zhao, Wenshi Xue. Stepwise Masking: A Masking Strategy Based on Stepwise Regression for Pre-training. In Wei Lu 0011, Shujian Huang, Yu Hong, Xiabing Zhou, editors, Natural Language Processing and Chinese Computing - 11th CCF International Conference, NLPCC 2022, Guilin, China, September 24-25, 2022, Proceedings, Part II. Volume 13552 of Lecture Notes in Computer Science, pages 131-142, Springer, 2022. [doi]

Abstract

Abstract is missing.