The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

Hugo Laurençon, Lucile Saulnier, Thomas Wang, Christopher Akiki, Albert Villanova del Moral, Teven Le Scao, Leandro von Werra, Chenghao Mou, Eduardo González Ponferrada, Huu Nguyen, Jörg Frohberg, Mario Sasko, Quentin Lhoest, Angelina McMillan-Major, Gérard Dupont, Stella Biderman, Anna Rogers, Loubna Ben Allal, Francesco De Toni, Giada Pistilli, Olivier Nguyen, Somaieh Nikpoor, Maraim Masoud, Pierre Colombo, Javier de la Rosa, Paulo Villegas, Tristan Thrush, Shayne Longpre, Sebastian Nagel 0005, Leon Weber, Manuel Muñoz, Jian Zhu, Daniel van Strien, Zaid Alyafeai, Khalid Almubarak, Minh Chien Vu, Itziar Gonzalez-Dios, Aitor Soroa, Kyle Lo, Manan Dey, Pedro Ortiz Suarez, Aaron Gokaslan, Shamik Bose, David Ifeoluwa Adelani, Long Phan, Hieu Tran, Ian Yu, Suhas Pai, Jenny Chim, Violette Lepercq, Suzana Ilic, Margaret Mitchell, Alexandra Sasha Luccioni, Yacine Jernite. The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset. In Sanmi Koyejo, S. Mohamed, A. Agarwal, Danielle Belgrave, K. Cho, A. Oh, editors, Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022. 2022. [doi]

Authors

Hugo Laurençon

This author has not been identified. Look up 'Hugo Laurençon' in Google

Lucile Saulnier

This author has not been identified. Look up 'Lucile Saulnier' in Google

Thomas Wang

This author has not been identified. Look up 'Thomas Wang' in Google

Christopher Akiki

This author has not been identified. Look up 'Christopher Akiki' in Google

Albert Villanova del Moral

This author has not been identified. Look up 'Albert Villanova del Moral' in Google

Teven Le Scao

This author has not been identified. Look up 'Teven Le Scao' in Google

Leandro von Werra

This author has not been identified. Look up 'Leandro von Werra' in Google

Chenghao Mou

This author has not been identified. Look up 'Chenghao Mou' in Google

Eduardo González Ponferrada

This author has not been identified. Look up 'Eduardo González Ponferrada' in Google

Huu Nguyen

This author has not been identified. Look up 'Huu Nguyen' in Google

Jörg Frohberg

This author has not been identified. Look up 'Jörg Frohberg' in Google

Mario Sasko

This author has not been identified. Look up 'Mario Sasko' in Google

Quentin Lhoest

This author has not been identified. Look up 'Quentin Lhoest' in Google

Angelina McMillan-Major

This author has not been identified. Look up 'Angelina McMillan-Major' in Google

Gérard Dupont

This author has not been identified. Look up 'Gérard Dupont' in Google

Stella Biderman

This author has not been identified. Look up 'Stella Biderman' in Google

Anna Rogers

This author has not been identified. Look up 'Anna Rogers' in Google

Loubna Ben Allal

This author has not been identified. Look up 'Loubna Ben Allal' in Google

Francesco De Toni

This author has not been identified. Look up 'Francesco De Toni' in Google

Giada Pistilli

This author has not been identified. Look up 'Giada Pistilli' in Google

Olivier Nguyen

This author has not been identified. Look up 'Olivier Nguyen' in Google

Somaieh Nikpoor

This author has not been identified. Look up 'Somaieh Nikpoor' in Google

Maraim Masoud

This author has not been identified. Look up 'Maraim Masoud' in Google

Pierre Colombo

This author has not been identified. Look up 'Pierre Colombo' in Google

Javier de la Rosa

This author has not been identified. Look up 'Javier de la Rosa' in Google

Paulo Villegas

This author has not been identified. Look up 'Paulo Villegas' in Google

Tristan Thrush

This author has not been identified. Look up 'Tristan Thrush' in Google

Shayne Longpre

This author has not been identified. Look up 'Shayne Longpre' in Google

Sebastian Nagel 0005

This author has not been identified. Look up 'Sebastian Nagel 0005' in Google

Leon Weber

This author has not been identified. Look up 'Leon Weber' in Google

Manuel Muñoz

This author has not been identified. Look up 'Manuel Muñoz' in Google

Jian Zhu

This author has not been identified. Look up 'Jian Zhu' in Google

Daniel van Strien

This author has not been identified. Look up 'Daniel van Strien' in Google

Zaid Alyafeai

This author has not been identified. Look up 'Zaid Alyafeai' in Google

Khalid Almubarak

This author has not been identified. Look up 'Khalid Almubarak' in Google

Minh Chien Vu

This author has not been identified. Look up 'Minh Chien Vu' in Google

Itziar Gonzalez-Dios

This author has not been identified. Look up 'Itziar Gonzalez-Dios' in Google

Aitor Soroa

This author has not been identified. Look up 'Aitor Soroa' in Google

Kyle Lo

This author has not been identified. Look up 'Kyle Lo' in Google

Manan Dey

This author has not been identified. Look up 'Manan Dey' in Google

Pedro Ortiz Suarez

This author has not been identified. Look up 'Pedro Ortiz Suarez' in Google

Aaron Gokaslan

This author has not been identified. Look up 'Aaron Gokaslan' in Google

Shamik Bose

This author has not been identified. Look up 'Shamik Bose' in Google

David Ifeoluwa Adelani

This author has not been identified. Look up 'David Ifeoluwa Adelani' in Google

Long Phan

This author has not been identified. Look up 'Long Phan' in Google

Hieu Tran

This author has not been identified. Look up 'Hieu Tran' in Google

Ian Yu

This author has not been identified. Look up 'Ian Yu' in Google

Suhas Pai

This author has not been identified. Look up 'Suhas Pai' in Google

Jenny Chim

This author has not been identified. Look up 'Jenny Chim' in Google

Violette Lepercq

This author has not been identified. Look up 'Violette Lepercq' in Google

Suzana Ilic

This author has not been identified. Look up 'Suzana Ilic' in Google

Margaret Mitchell

This author has not been identified. Look up 'Margaret Mitchell' in Google

Alexandra Sasha Luccioni

This author has not been identified. Look up 'Alexandra Sasha Luccioni' in Google

Yacine Jernite

This author has not been identified. Look up 'Yacine Jernite' in Google