Taking Notes on the Fly Helps Language Pre-Training

Qiyu Wu 0001, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu. Taking Notes on the Fly Helps Language Pre-Training. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. [doi]

Abstract

Abstract is missing.