Nafis Sadeq, Canwen Xu, Julian J. McAuley. InforMask: Unsupervised Informative Masking for Language Model Pretraining. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11. pages 5866-5878, Association for Computational Linguistics, 2022. [doi]
Abstract is missing.