Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction

Shubhanshu Mishra, Aria Haghighi. Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction. In Wei Xu 0004, Alan Ritter, Tim Baldwin, Afshin Rahimi 0001, editors, Proceedings of the Seventh Workshop on Noisy User-generated Text, W-NUT 2021, Online, November 11, 2021. pages 381-388, Association for Computational Linguistics, 2021. [doi]

@inproceedings{MishraH21,
  title = {Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction},
  author = {Shubhanshu Mishra and Aria Haghighi},
  year = {2021},
  url = {https://aclanthology.org/2021.wnut-1.42},
  researchr = {https://researchr.org/publication/MishraH21},
  cites = {0},
  citedby = {0},
  pages = {381-388},
  booktitle = {Proceedings of the Seventh Workshop on Noisy User-generated Text, W-NUT 2021, Online, November 11, 2021},
  editor = {Wei Xu 0004 and Alan Ritter and Tim Baldwin and Afshin Rahimi 0001},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-954085-90-9},
}