Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets

Julia Kreutzer, Isaac Caswell, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Suárez, Iroro Orife, Kelechi Ogueji, Andre Niyongabo Rubungo, Toan Q. Nguyen, Mathias Müller 0002, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Balli, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi. Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets. TACL, 10:50-72, 2022. [doi]

Authors

Julia Kreutzer

This author has not been identified. Look up 'Julia Kreutzer' in Google

Isaac Caswell

This author has not been identified. Look up 'Isaac Caswell' in Google

Lisa Wang

This author has not been identified. Look up 'Lisa Wang' in Google

Ahsan Wahab

This author has not been identified. Look up 'Ahsan Wahab' in Google

Daan van Esch

This author has not been identified. Look up 'Daan van Esch' in Google

Nasanbayar Ulzii-Orshikh

This author has not been identified. Look up 'Nasanbayar Ulzii-Orshikh' in Google

Allahsera Tapo

This author has not been identified. Look up 'Allahsera Tapo' in Google

Nishant Subramani

This author has not been identified. Look up 'Nishant Subramani' in Google

Artem Sokolov

This author has not been identified. Look up 'Artem Sokolov' in Google

Claytone Sikasote

This author has not been identified. Look up 'Claytone Sikasote' in Google

Monang Setyawan

This author has not been identified. Look up 'Monang Setyawan' in Google

Supheakmungkol Sarin

This author has not been identified. It may be one of the following persons: Look up 'Supheakmungkol Sarin' in Google

Sokhar Samb

This author has not been identified. Look up 'Sokhar Samb' in Google

Benoît Sagot

This author has not been identified. Look up 'Benoît Sagot' in Google

Clara Rivera

This author has not been identified. Look up 'Clara Rivera' in Google

Annette Rios

This author has not been identified. Look up 'Annette Rios' in Google

Isabel Papadimitriou

This author has not been identified. Look up 'Isabel Papadimitriou' in Google

Salomey Osei

This author has not been identified. Look up 'Salomey Osei' in Google

Pedro Javier Ortiz Suárez

This author has not been identified. Look up 'Pedro Javier Ortiz Suárez' in Google

Iroro Orife

This author has not been identified. Look up 'Iroro Orife' in Google

Kelechi Ogueji

This author has not been identified. Look up 'Kelechi Ogueji' in Google

Andre Niyongabo Rubungo

This author has not been identified. Look up 'Andre Niyongabo Rubungo' in Google

Toan Q. Nguyen

This author has not been identified. Look up 'Toan Q. Nguyen' in Google

Mathias Müller 0002

This author has not been identified. Look up 'Mathias Müller 0002' in Google

André Müller

This author has not been identified. Look up 'André Müller' in Google

Shamsuddeen Hassan Muhammad

This author has not been identified. Look up 'Shamsuddeen Hassan Muhammad' in Google

Nanda Muhammad

This author has not been identified. Look up 'Nanda Muhammad' in Google

Ayanda Mnyakeni

This author has not been identified. Look up 'Ayanda Mnyakeni' in Google

Jamshidbek Mirzakhalov

This author has not been identified. Look up 'Jamshidbek Mirzakhalov' in Google

Tapiwanashe Matangira

This author has not been identified. Look up 'Tapiwanashe Matangira' in Google

Colin Leong

This author has not been identified. Look up 'Colin Leong' in Google

Nze Lawson

This author has not been identified. Look up 'Nze Lawson' in Google

Sneha Kudugunta

This author has not been identified. Look up 'Sneha Kudugunta' in Google

Yacine Jernite

This author has not been identified. Look up 'Yacine Jernite' in Google

Mathias Jenny

This author has not been identified. Look up 'Mathias Jenny' in Google

Orhan Firat

This author has not been identified. Look up 'Orhan Firat' in Google

Bonaventure F. P. Dossou

This author has not been identified. Look up 'Bonaventure F. P. Dossou' in Google

Sakhile Dlamini

This author has not been identified. Look up 'Sakhile Dlamini' in Google

Nisansa de Silva

This author has not been identified. It may be one of the following persons: Look up 'Nisansa de Silva' in Google

Sakine Çabuk Balli

This author has not been identified. Look up 'Sakine Çabuk Balli' in Google

Stella Biderman

This author has not been identified. Look up 'Stella Biderman' in Google

Alessia Battisti

This author has not been identified. Look up 'Alessia Battisti' in Google

Ahmed Baruwa

This author has not been identified. Look up 'Ahmed Baruwa' in Google

Ankur Bapna

This author has not been identified. Look up 'Ankur Bapna' in Google

Pallavi Baljekar

This author has not been identified. Look up 'Pallavi Baljekar' in Google

Israel Abebe Azime

This author has not been identified. Look up 'Israel Abebe Azime' in Google

Ayodele Awokoya

This author has not been identified. Look up 'Ayodele Awokoya' in Google

Duygu Ataman

This author has not been identified. Look up 'Duygu Ataman' in Google

Orevaoghene Ahia

This author has not been identified. Look up 'Orevaoghene Ahia' in Google

Oghenefego Ahia

This author has not been identified. Look up 'Oghenefego Ahia' in Google

Sweta Agrawal

This author has not been identified. Look up 'Sweta Agrawal' in Google

Mofetoluwa Adeyemi

This author has not been identified. Look up 'Mofetoluwa Adeyemi' in Google