Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets

• Julia Kreutzer,
• Isaac Caswell,
• Lisa Wang,
• Ahsan Wahab,
• Daan van Esch,
• Nasanbayar Ulzii-Orshikh,
• Allahsera Tapo,
• Nishant Subramani,
• Artem Sokolov,
• Claytone Sikasote,
• Monang Setyawan,
• Supheakmungkol Sarin,
• Sokhar Samb,
• Benoît Sagot,
• Clara Rivera,
• Annette Rios,
• Isabel Papadimitriou,
• Salomey Osei,
• Pedro Ortiz Suarez,
• Iroro Orife,
• Kelechi Ogueji,
• Andre Niyongabo Rubungo,
• Toan Q. Nguyen,
• Mathias Müller,
• André Müller,
• Shamsuddeen Hassan Muhammad,
• Nanda Muhammad,
• Ayanda Mnyakeni,
• Jamshidbek Mirzakhalov,
• Tapiwanashe Matangira,
• Colin Leong,
• Nze Lawson,
• Sneha Kudugunta,
• Yacine Jernite,
• Mathias Jenny,
• Orhan Firat,
• Bonaventure F. P. Dossou,
• Sakhile Dlamini,
• Nisansa de Silva,
• Sakine Çabuk Ballı,
• Stella Biderman,
• Alessia Battisti,
• Ahmed Baruwa,
• Ankur Bapna,
• Pallavi Baljekar,
• Israel Abebe Azime,
• Ayodele Awokoya,
• Duygu Ataman,
• Orevaoghene Ahia,
• Oghenefego Ahia,
• Sweta Agrawal,
• Mofetoluwa Adeyemi

Affiliations

Julia Kreutzer

Isaac Caswell

Lisa Wang

Ahsan Wahab

Daan van Esch

Nasanbayar Ulzii-Orshikh

Allahsera Tapo

Nishant Subramani

Artem Sokolov

Claytone Sikasote

Monang Setyawan

Supheakmungkol Sarin

Sokhar Samb

Benoît Sagot

Clara Rivera

Annette Rios

Isabel Papadimitriou

Salomey Osei

Pedro Ortiz Suarez

Iroro Orife

Kelechi Ogueji

Andre Niyongabo Rubungo

Toan Q. Nguyen

Mathias Müller

André Müller

Shamsuddeen Hassan Muhammad

Nanda Muhammad

Ayanda Mnyakeni

Jamshidbek Mirzakhalov

Tapiwanashe Matangira

Colin Leong

Nze Lawson

Sneha Kudugunta

Yacine Jernite

Mathias Jenny

Orhan Firat

Bonaventure F. P. Dossou

Sakhile Dlamini

Nisansa de Silva

Sakine Çabuk Ballı

Stella Biderman

Alessia Battisti

Ahmed Baruwa

Ankur Bapna

Pallavi Baljekar

Israel Abebe Azime

Ayodele Awokoya

Duygu Ataman

Orevaoghene Ahia

Oghenefego Ahia

Sweta Agrawal

Mofetoluwa Adeyemi