Datasets › ParaCrawl

ParaCrawl

Introduced by Marta Ba{\~n}{\'o}n et al. in ParaCrawl: Web-Scale Acquisition of Parallel Corpora1 Jul 2020 archive 2025-07-28

ParaCrawl v.7.1 is a parallel dataset with 41 language pairs primarily aligned with English (39 out of 41) and mined using the parallel-data-crawling tool Bitextor which includes downloading documents, preprocessing and normalization, aligning documents and segments, and filtering noisy data via Bicleaner. ParaCrawl focuses on European languages, but also includes 9 lower-resource, non-European language pairs in v7.1.

Source: Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 66 papers for it but never published that list.

Dataset loaders archive 2025-07-28

3 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

No task tagged in the archive.

License archive 2025-07-28

CC0

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • ParaCrawl

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections