When Do You Need Billions of Words of Pretraining Data?

Yian Zhang, Alex Warstadt, Xiaocheng Li, Samuel R. Bowman. When Do You Need Billions of Words of Pretraining Data?. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. pages 1112-1125, Association for Computational Linguistics, 2021. [doi]

Authors

Yian Zhang

This author has not been identified. Look up 'Yian Zhang' in Google

Alex Warstadt

This author has not been identified. Look up 'Alex Warstadt' in Google

Xiaocheng Li

This author has not been identified. Look up 'Xiaocheng Li' in Google

Samuel R. Bowman

This author has not been identified. Look up 'Samuel R. Bowman' in Google