Datasets › OSCAR
OSCAR
Introduced by Pedro Javier Ortiz Suárez et al. in
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages 11 Jun 2020 archive 2025-07-28
OSCAR or Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture. The dataset used for training multilingual models such as BART incorporates 138 GB of text.
Benchmarks archive 2025-07-28
No leaderboard in the archive resolves to this dataset.
Papers archive 2025-07-28
No paper in the archive has a leaderboard row on this dataset; the archive counts 64 papers for it but never published that list.
Dataset loaders archive 2025-07-28
20 loaders as listed in the archive; links are outbound and not re-checked here.
Tasks archive 2025-07-28
License archive 2025-07-28
CC0 1.0
Modalities archive 2025-07-28
Languages archive 2025-07-28
Variants archive 2025-07-28
1 variant name, as the archive lists them.
At a glance archive 2025-07-28
Introduced 11 Jun 2020 Papers 64
Benchmarks 0
With a result 0
Licence CC0 1.0 Modalities Texts Languages English, French, Spanish, German, Italian, Chinese, Bengali, Multilingual, Japanese, Russian, Portuguese, Afrikaans, Albanian, Amharic, Arabic, Armenian, Basque, Belarusian, Breton, Bulgarian, Catalan, Croatian, Czech, Danish, Dutch, Erzya, Estonian, Finnish, Galician, Hebrew, Hindi, Hungarian, Icelandic, Indonesian, Irish, Kazakh, Korean, Latin, Latvian, Lithuanian, Maltese, Marathi, Modern Greek, Norwegian, Persian, Polish, Romanian, Russia Buriat, Sanskrit, Scottish Gaelic, Serbian, Slovak, Slovenian, Swedish, Tagalog, Tamil, Telugu, Thai, Turkish, Uighur, Ukrainian, Upper Sorbian, Urdu, Vietnamese, Welsh, Yoruba, Yue Chinese, Swahili, Aragonese, Egyptian Arabic, Assamese, Asturian, Avaric, South Azerbaijani, Azerbaijani, Bashkir, Bavarian, Central Bikol, Tibetan, Bosnian, Bishnupriya, Chavacano, Cebuano, Chechen, Chuvash, Central Kurdish, Cornish, Dimli (individual language), Dhivehi, Lower Sorbian, Esperanto, Northern Frisian, Western Frisian, Goan Konkani, Guarani, Gujarati, Haitian, Serbo-Croatian, Ido, Interlingue, Iloko, Javanese, Lojban, Kannada, Georgian, Central Khmer, Kirghiz, Komi, Karachay-Balkar, Kurdish, Lao, Lezghian, Limburgan, Lombard, Northern Luri, Luxembourgish, Maithili, Malayalam, Eastern Mari, Minangkabau, Macedonian, Malagasy, Mongolian, Western Mari, Mirandese, Burmese, Mazanderani, Neapolitan, Low German, Newari, Norwegian Nynorsk, Occitan (post 1500), Oriya (macrolanguage), Ossetian, Pampanga, Punjabi, Piemontese, Western Panjabi, Pushto, Quechua, Romansh, Yakut, Sicilian, Sinhala, Sindhi, Somali, Sundanese, Tatar, Tajik, Turkmen, Tuvinian, Uzbek, Venetian, Volapük, Waray (Philippines), Walloon, Wu Chinese, Kalmyk, Mingrelian, Yiddish, Malay (individual language) Loaders 20 Homepage oscar-corpus.com/
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections