Larger-Scale Transformers for Multilingual Masked Language Modeling

Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau. Larger-Scale Transformers for Multilingual Masked Language Modeling. In Anna Rogers, Iacer Calixto, Ivan Vulic, Naomi Saphra, Nora Kassner, Oana-Maria Camburu, Trapit Bansal, Vered Shwartz, editors, Proceedings of the 6th Workshop on Representation Learning for NLP, RepL4NLP@ACL-IJCNLP 2021, Online, August 6, 2021. pages 29-33, Association for Computational Linguistics, 2021. [doi]

@inproceedings{GoyalDOAC21,
  title = {Larger-Scale Transformers for Multilingual Masked Language Modeling},
  author = {Naman Goyal and Jingfei Du and Myle Ott and Giri Anantharaman and Alexis Conneau},
  year = {2021},
  url = {https://aclanthology.org/2021.repl4nlp-1.4},
  researchr = {https://researchr.org/publication/GoyalDOAC21},
  cites = {0},
  citedby = {0},
  pages = {29-33},
  booktitle = {Proceedings of the 6th Workshop on Representation Learning for NLP, RepL4NLP@ACL-IJCNLP 2021, Online, August 6, 2021},
  editor = {Anna Rogers and Iacer Calixto and Ivan Vulic and Naomi Saphra and Nora Kassner and Oana-Maria Camburu and Trapit Bansal and Vered Shwartz},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-954085-72-5},
}