Parallel Corpus Mining

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

8 shown of 8 papers with code (13 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
  26 Dec 2018 13 repositories listed Syntology ran 4 of 10 samples · 6 unverified · 4 pointer-only (licence)
  We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
• Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddings
  3 Nov 2018 9 repositories listed
  Machine translation is highly sensitive to the size and quality of the training data, which has led to an increasing interest in collecting and filtering large parallel corpora.
• ParaCrawl: Web-Scale Acquisition of Parallel Corpora
  1 Jul 2020 2 repositories listed
  We report on methods to create the largest publicly available parallel corpora by crawling the web, using open source software.
• Bilingual Corpus Mining and Multistage Fine-Tuning for Improving Machine Translation of Lecture Transcripts
  7 Nov 2023 1 repository listed
  To create the parallel corpora, we propose a dynamic programming based sentence alignment algorithm which leverages the cosine similarity of machine-translated sentences.
• USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation
  21 Feb 2022 1 repository listed
  We show that our fully unsupervised metrics are effective, i.
• Parallel Sentence Mining by Constrained Decoding
  1 Jul 2020 1 repository listed
  We present a novel method to extract parallel sentences from two monolingual corpora, using neural machine translation.
• MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases
  1 May 2020 1 repository listed
  Progress in sentence simplification has been hindered by a lack of labeled parallel simplification data, particularly in languages other than English.
• Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  26 Dec 2019 1 repository listed
  To address this, we examine a language independent framework for parallel corpus mining which is a quick and effective way to mine a parallel corpus from publicly available lectures at Coursera.

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.