Machine Translation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

84 leaderboard tables shown for this task, 84 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 84 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

82 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 82 until expanded.

Subtasks archive 2025-07-28

10 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 2,444 papers with code (10,752 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Attention Is All You Need
  12 Jun 2017 595 repositories listed Syntology ran 600 of 946 samples · 346 unverified · 451 pointer-only (licence)
  The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration.
• Neural Machine Translation by Jointly Learning to Align and Translate
  1 Sep 2014 124 repositories listed Syntology ran 21 of 44 samples · 23 unverified · 16 pointer-only (licence)
  Neural machine translation is a recently proposed approach to machine translation.
• Sequence to Sequence Learning with Neural Networks
  10 Sep 2014 74 repositories listed Syntology ran 11 of 25 samples · 14 unverified · 9 pointer-only (licence)
  Our method uses a multilayered Long Short-Term Memory (LSTM) to map the input sequence to a vector of a fixed dimensionality, and then another deep LSTM to decode the target sequence from the vector.
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
  23 Oct 2019 57 repositories listed Syntology ran 2 of 31 samples · 29 unverified
  Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP).
• BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
  29 Oct 2019 47 repositories listed Syntology ran 22 of 53 samples · 31 unverified · 7 pointer-only (licence)
  We evaluate a number of noising approaches, finding the best performance by both randomly shuffling the order of the original sentences and using a novel in-filling scheme, where spans of text are replaced with a single…
• Effective Approaches to Attention-based Neural Machine Translation
  17 Aug 2015 44 repositories listed Syntology ran 2 of 8 samples · 6 unverified · 2 pointer-only (licence)
  Our ensemble model using different attention architectures has established a new state-of-the-art result in the WMT'15 English to German translation task with 25.
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
  3 Jun 2014 42 repositories listed Syntology ran 10 of 22 samples · 12 unverified · 14 pointer-only (licence)
  In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN).
• Convolutional Sequence to Sequence Learning
  8 May 2017 37 repositories listed
  The prevalent approach to sequence to sequence learning maps an input sequence to a variable length output sequence via recurrent neural networks.
• An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
  4 Mar 2018 35 repositories listed Syntology ran 2 of 10 samples · 8 unverified · 1 pointer-only (licence)
  Our results indicate that a simple convolutional architecture outperforms canonical recurrent networks such as LSTMs across a diverse range of tasks and datasets, while demonstrating longer effective memory.
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
  26 Sep 2016 28 repositories listed Syntology ran 23 of 46 samples · 23 unverified · 12 pointer-only (licence)
  To improve parallelism and therefore decrease training time, our attention mechanism connects the bottom layer of the decoder to the top layer of the encoder.
• 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
  21 Jun 2016 27 repositories listed Syntology ran 53 of 76 samples · 23 unverified · 20 pointer-only (licence)
  This paper introduces a network for volumetric segmentation that learns from sparsely annotated volumetric images.
• Neural Machine Translation of Rare Words with Subword Units
  31 Aug 2015 26 repositories listed Syntology ran 21 of 30 samples · 9 unverified · 21 pointer-only (licence)
  Neural machine translation (NMT) models typically operate with a fixed vocabulary, but translation is an open-vocabulary problem.
• Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models
  7 Oct 2016 25 repositories listed Syntology ran 7 of 14 samples · 7 unverified · 14 pointer-only (licence)
  We observe that our method consistently outperforms BS and previously proposed techniques for diverse decoding from neural sequence models.
• On the Variance of the Adaptive Learning Rate and Beyond
  8 Aug 2019 21 repositories listed Syntology ran 4 of 13 samples · 9 unverified
  The learning rate warmup heuristic achieves remarkable success in stabilizing training, accelerating convergence and improving generalization for adaptive stochastic optimization algorithms like RMSprop and Adam.
• Language Models are Unsupervised Multitask Learners
  14 Feb 2019 21 repositories listed
  Natural language processing tasks, such as question answering, machine translation, reading comprehension, and summarization, are typically approached with supervised learning on taskspecific datasets.
• Recurrent Neural Network Regularization
  8 Sep 2014 21 repositories listed Syntology ran 2 of 6 samples · 4 unverified · 6 pointer-only (licence)
  We present a simple regularization technique for Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units.
• BERTScore: Evaluating Text Generation with BERT
  21 Apr 2019 20 repositories listed Syntology ran 44 of 76 samples · 32 unverified · 33 pointer-only (licence)
  We propose BERTScore, an automatic evaluation metric for text generation.
• Word Translation Without Parallel Data
  11 Oct 2017 20 repositories listed Syntology ran 6 of 8 samples · 2 unverified · 8 pointer-only (licence)
  We finally describe experiments on the English-Esperanto low-resource language pair, on which there only exists a limited amount of parallel data, to show the potential impact of our method in fully unsupervised machine…
• ResMLP: Feedforward networks for image classification with data-efficient training
  7 May 2021 19 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  We present ResMLP, an architecture built entirely upon multi-layer perceptrons for image classification.
• Lookahead Optimizer: k steps forward, 1 step back
  19 Jul 2019 19 repositories listed
  The vast majority of successful deep neural networks are trained using variants of stochastic gradient descent (SGD) algorithms.
• Cross-lingual Language Model Pretraining
  22 Jan 2019 17 repositories listed Syntology ran 1 of 7 samples · 6 unverified · 1 pointer-only (licence)
  On unsupervised machine translation, we obtain 34.
• Sockeye: A Toolkit for Neural Machine Translation
  15 Dec 2017 16 repositories listed
  Written in Python and built on MXNet, the toolkit offers scalable training and inference for the three most prominent encoder-decoder architectures: attentional recurrent neural networks, self-attentional transformers,…
• QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
  23 Apr 2018 15 repositories listed Syntology ran 7 of 19 samples · 12 unverified · 2 pointer-only (licence)
  On the SQuAD dataset, our model is 3x to 13x faster in training and 4x to 9x faster in inference, while achieving equivalent accuracy to recurrent models.
• Tensor2Tensor for Neural Machine Translation
  16 Mar 2018 15 repositories listed Syntology ran 1 of 48 samples · 47 unverified
  Tensor2Tensor is a library for deep learning models that is well-suited for neural machine translation and includes the reference implementation of the state-of-the-art Transformer model.
• Phrase-Based & Neural Unsupervised Machine Translation
  20 Apr 2018 14 repositories listed
  Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability…
• Unsupervised Machine Translation Using Monolingual Corpora Only
  31 Oct 2017 14 repositories listed Syntology ran 3 of 14 samples · 11 unverified · 5 pointer-only (licence)
  By learning to reconstruct in both languages from this shared feature space, the model effectively learns to translate without using any labeled data.
• Attention-Based Models for Speech Recognition
  24 Jun 2015 14 repositories listed
  Recurrent sequence generators conditioned on input data through an attention mechanism have recently shown very good performance on a range of tasks in- cluding machine translation, handwriting synthesis and image…
• GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
  16 Nov 2018 13 repositories listed Syntology ran 1 of 25 samples · 24 unverified · 16 pointer-only (licence)
  Scaling up deep neural network capacity has been known as an effective approach to improving model quality for several different machine learning tasks.
• Self-Attention with Relative Position Representations
  6 Mar 2018 13 repositories listed Syntology ran 13 of 23 samples · 10 unverified · 3 pointer-only (licence)
  On the WMT 2014 English-to-German and English-to-French translation tasks, this approach yields improvements of 1.
• FNet: Mixing Tokens with Fourier Transforms
  9 May 2021 12 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 1 pointer-only (licence)
  At longer input lengths, our FNet model is significantly faster: when compared to the "efficient" Transformers on the Long Range Arena benchmark, FNet matches the accuracy of the most accurate models, while outpacing…

Syntology lines on 24 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.