InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

Zewen Chi, Li Dong 0004, Furu Wei, Nan Yang 0002, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou 0001. InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. In Kristina Toutanova, Anna Rumshisky, Luke Zettlemoyer, Dilek Hakkani-Tür, Iz Beltagy, Steven Bethard, Ryan Cotterell, Tanmoy Chakraborty 0002, Yichao Zhou, editors, Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021, Online, June 6-11, 2021. pages 3576-3588, Association for Computational Linguistics, 2021. [doi]

Authors

Zewen Chi

This author has not been identified. Look up 'Zewen Chi' in Google

Li Dong 0004

This author has not been identified. Look up 'Li Dong 0004' in Google

Furu Wei

This author has not been identified. Look up 'Furu Wei' in Google

Nan Yang 0002

This author has not been identified. Look up 'Nan Yang 0002' in Google

Saksham Singhal

This author has not been identified. Look up 'Saksham Singhal' in Google

Wenhui Wang

This author has not been identified. Look up 'Wenhui Wang' in Google

Xia Song

This author has not been identified. Look up 'Xia Song' in Google

Xian-Ling Mao

This author has not been identified. Look up 'Xian-Ling Mao' in Google

Heyan Huang

This author has not been identified. Look up 'Heyan Huang' in Google

Ming Zhou 0001

This author has not been identified. Look up 'Ming Zhou 0001' in Google