Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction

Shubhanshu Mishra, Aria Haghighi. Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction. In Wei Xu 0004, Alan Ritter, Tim Baldwin, Afshin Rahimi 0001, editors, Proceedings of the Seventh Workshop on Noisy User-generated Text, W-NUT 2021, Online, November 11, 2021. pages 381-388, Association for Computational Linguistics, 2021. [doi]

Abstract

Abstract is missing.