Browse State-of-the-Art › Parallel Corpus Mining
Parallel Corpus Mining
8 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Mining a corpus of bilingual sentence pairs that are translations of each other.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 13 · with a code link: 8 · where Syntology ran a sample: 1 (1 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1 of 13 tagged: 1 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 13 of 13, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
26 Dec 2018 13 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 4 pointer-only (licence)We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
-
3 Nov 2018 9 repositories listedMachine translation is highly sensitive to the size and quality of the training data, which has led to an increasing interest in collecting and filtering large parallel corpora.
-
1 Jul 2020 2 repositories listedWe report on methods to create the largest publicly available parallel corpora by crawling the web, using open source software.
-
7 Nov 2023 1 repository listedTo create the parallel corpora, we propose a dynamic programming based sentence alignment algorithm which leverages the cosine similarity of machine-translated sentences.
-
21 Feb 2022 1 repository listedWe show that our fully unsupervised metrics are effective, i. e., they beat supervised competitors on 4 out of our 5 evaluation datasets.
-
1 Jul 2020 1 repository listedWe present a novel method to extract parallel sentences from two monolingual corpora, using neural machine translation.
-
1 May 2020 1 repository listedProgress in sentence simplification has been hindered by a lack of labeled parallel simplification data, particularly in languages other than English.
-
26 Dec 2019 1 repository listedTo address this, we examine a language independent framework for parallel corpus mining which is a quick and effective way to mine a parallel corpus from publicly available lectures at Coursera.
-
15 Mar 2022 0 repositories listed Syntology 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)Quality Estimation (QE) models have the potential to change how we evaluate and maybe even train machine translation models.
-
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining21 May 2021 0 repositories listedExisting models of multilingual sentence embeddings require large parallel data resources which are not available for low-resource languages.
-
Unsupervised Parallel Corpus Mining on Web Data18 Sep 2020 0 repositories listedWith a large amount of parallel data, neural machine translation systems are able to deliver human-level performance for sentence-level translation.
-
Hierarchical Document Encoder for Parallel Corpus Mining20 Jun 2019 0 repositories listedWe explore using multilingual document embeddings for nearest neighbor mining of parallel data.
-
Effective Parallel Corpus Mining using Bilingual Sentence Embeddings31 Jul 2018 0 repositories listedThis paper presents an effective approach for parallel corpus mining using bilingual sentence embeddings.
Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections