Papers › Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

3 Jun 2014arXiv:1406.1078archive 2025-07-28

Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio

In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN). One RNN encodes a sequence of symbols into a fixed-length vector representation, and the other decodes the representation into another sequence of symbols. The encoder and decoder of the proposed model are jointly trained to maximize the conditional probability of a target sequence given a source sequence. The performance of a statistical machine translation system is empirically found to improve by using the conditional probabilities of phrase pairs computed by the RNN Encoder-Decoder as an additional feature in the existing log-linear model. Qualitatively, we show that the proposed model learns a semantically and syntactically meaningful representation of linguistic phrases.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1406.1078")

Code

Syntology Ran 10 of 22 code samples harvested from 13 repositories linked to this paper; 12 have no recorded run. Of those that ran: 2 ran · our draft was wrong; 1 ran · fixture could not drive it; 7 ran with no contract checked.

By repository: community (archive-listed): 22 samples from 13 repositories, 10 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

42 repositories listed; official and paper-mentioned ones first.

2023-MindSpore-1/ms-code-61 mentioned on GitHubmindsporeApache-2.0 report
2023-MindSpore-1/ms-code-62 mentioned on GitHubmindsporeApache-2.0 report
Avmb/lowrank-gru mentioned on GitHubNOASSERTION report
CongBao/ChatBot mentioned on GitHub report
Nick-Zhao-Engr/Machine-Translation mentioned on GitHubpytorch report
bentrevett/pytorch-seq2seq mentioned on GitHubpytorchMIT report
dksifoua/Neural-Machine-Translation mentioned on GitHubpytorch report
erickrf/autoencoder mentioned on GitHubtf report
euiyulsong/EncoderDecoder mentioned on GitHubpytorch report
farizrahman4u/seq2seq mentioned on GitHub report
graykode/nlp-tutorial mentioned on GitHubpytorch report
jmyrberg/finnlem mentioned on GitHubtf report
kingcong/gpu_gru mentioned on GitHubmindsporenot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-ready report
kmzzhang/nbi mentioned on GitHubpytorch report
lmnt-com/haste mentioned on GitHubtfApache-2.0 report
magahub/songrnn mentioned on GitHubtf report
miniii222/Graduate-Paper mentioned on GitHubtf report
mp2893/gram mentioned on GitHubBSD-3-Clause report
ratschlab/HIRID-ICU-Benchmark mentioned on GitHubpytorchMIT report
rvandewater/yaib mentioned on GitHubpytorchMIT report
spratskevich/Lemmatizer mentioned on GitHub report
starry91/NMT-Lab mentioned on GitHub report
trevor-richardson/rnn_zoo mentioned on GitHubpytorch report
umeiko/mindspore-seq2seq mentioned on GitHubmindspore report
vGkatsis/Chat_Bot_DL mentioned on GitHubpytorch report
yangyucheng000/ascend_gru mentioned on GitHubmindsporeApache-2.0 report
hwzwx1190522/gru mindsporeApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

22 samples harvested; 10 ran; 0 honoured the contract we drafted; 12 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · our draft was wrong
1ran · fixture could not drive it
7ran
12unverified

Licence: 14 of the 22 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 13 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

Encoder euiyulsong/EncoderDecoder/encoder.py community (archive-listed) ran · metamorphic tier: deterministic no licence file found · pointer only · a720c5f891a66dd6 · report
EncoderBiGruLayer dksifoua/Neural-Machine-Translation/nmt/layers/encoder/encoder_gru_layer.py community (archive-listed) ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · f2cdae86ccaa8620 · report
RNN kmzzhang/nbi/src/nbi/nn/rnn.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted licence not identified · pointer only · 3608961b6a79dbfb · report
RNN trevor-richardson/rnn_zoo/models/rnn.py community (archive-listed) ran no licence file found · pointer only · bbc681afcb7c583e · report
RNNCell trevor-richardson/rnn_zoo/models/rnn.py community (archive-listed) ran no licence file found · pointer only · b213e3b667ed9364 · report
Seq2Seq Nick-Zhao-Engr/Machine-Translation/hannmtModel/HANNMT/compare/1_RNN_Encoder-Decoder_for_SMT.py community (archive-listed) ran no licence file found · pointer only · 97aaf6f5558112f8 · report
Seq2Seq littleflow3r/Japanese_English_Machine_Translation_Seq2Seq/model.py community (archive-listed) ran no licence file found · pointer only · c1747f21ffe18473 · report
merge hwzwx1190522/gru/gru/model_utils/config.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · b9e24c3e3e0e88a7 · report
modelTranslation dewanderelex/LanguageTranslation/util.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 6ec7b51612b58567 · report
preprocess_targets advaithsrao/Chatbot_Seq2seq_model/utils/utils_model.py community (archive-listed) ran · fixture could not drive it no licence file found · pointer only · 793c786005ec4b85 · report
RNN roomylee/rnn-text-classification-tf/rnn.py community (archive-listed) unverified MIT (permissive) · a4dc486e7ada770a · report
Seq2Seq graykode/nlp-tutorial/4-1.Seq2Seq/Seq2Seq.py community (archive-listed) unverified MIT (permissive) · 0e85857408d20491 · report
TextAutoencoder erickrf/autoencoder/src/autoencoder.py community (archive-listed) unverified MIT (permissive) · 44d515405606f156 · report
decode_test_set advaithsrao/Chatbot_Seq2seq_model/utils/utils_model.py community (archive-listed) unverified no licence file found · pointer only · a0690530865eb4a7 · report
decode_training_set advaithsrao/Chatbot_Seq2seq_model/utils/utils_model.py community (archive-listed) unverified no licence file found · pointer only · 88c7d27261415215 · report
decoder_rnn advaithsrao/Chatbot_Seq2seq_model/utils/utils_model.py community (archive-listed) unverified no licence file found · pointer only · 57bad7abfb64d43c · report
encoder_rnn advaithsrao/Chatbot_Seq2seq_model/utils/utils_model.py community (archive-listed) unverified no licence file found · pointer only · 51b90f5478c6a565 · report
get_instance_features hwzwx1190522/gru/gru/src/create_data.py community (archive-listed) unverified Apache-2.0 (permissive) · 1e7dce39d953aaa5 · report
lstm_kr_pos munir-bd/Korean-POS-Tagger-LSTM/LSTM_KR_PoS.py community (archive-listed) unverified MIT (permissive) · 8efe3d0ceebe7022 · report
parse_cli_to_yaml hwzwx1190522/gru/gru/model_utils/config.py community (archive-listed) unverified Apache-2.0 (permissive) · 738456e1b7388e7e · report
parse_yaml hwzwx1190522/gru/gru/model_utils/config.py community (archive-listed) unverified Apache-2.0 (permissive) · 96a9939953d5992d · report
seq2seq_model advaithsrao/Chatbot_Seq2seq_model/utils/utils_model.py community (archive-listed) unverified no licence file found · pointer only · 7e401a2586a3aa60 · report

Tasks

DecoderMachine TranslationTranslation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Machine Translation WMT2014 English-French CSLM + RNN + WP BLEU score 34.54 #48 of 57 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: GRU

GRU

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections