Decoder

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 4,358 papers with code (10,368 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Attention Is All You Need
  12 Jun 2017 595 repositories listed Syntology ran 600 of 946 samples · 346 unverified · 451 pointer-only (licence)
  The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration.
• Neural Machine Translation by Jointly Learning to Align and Translate
  1 Sep 2014 124 repositories listed Syntology ran 21 of 44 samples · 23 unverified · 16 pointer-only (licence)
  Neural machine translation is a recently proposed approach to machine translation.
• Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
  7 Feb 2018 78 repositories listed Syntology ran 43 of 72 samples · 29 unverified · 40 pointer-only (licence)
  The former networks are able to encode multi-scale contextual information by probing the incoming features with filters or pooling operations at multiple rates and multiple effective fields-of-view, while the latter…
• SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
  2 Nov 2015 74 repositories listed Syntology ran 9 of 44 samples · 35 unverified · 10 pointer-only (licence)
  We show that SegNet provides good performance with competitive inference time and more efficient inference memory-wise as compared to other architectures.
• Searching for MobileNetV3
  6 May 2019 67 repositories listed Syntology ran 58 of 105 samples · 47 unverified · 46 pointer-only (licence)
  We achieve new state of the art results for mobile classification, detection and segmentation.
• Masked Autoencoders Are Scalable Vision Learners
  11 Nov 2021 58 repositories listed Syntology ran 71 of 137 samples · 66 unverified · 73 pointer-only (licence)
  Our MAE approach is simple: we mask random patches of the input image and reconstruct the missing pixels.
• Neural Discrete Representation Learning
  2 Nov 2017 50 repositories listed Syntology ran 53 of 80 samples · 27 unverified · 32 pointer-only (licence)
  Learning useful representations without supervision remains a key challenge in machine learning.
• BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
  29 Oct 2019 47 repositories listed Syntology ran 22 of 53 samples · 31 unverified · 7 pointer-only (licence)
  We evaluate a number of noising approaches, finding the best performance by both randomly shuffling the order of the original sentences and using a novel in-filling scheme, where spans of text are replaced with a single…
• High Quality Monocular Depth Estimation via Transfer Learning
  31 Dec 2018 45 repositories listed Syntology ran 5 of 23 samples · 18 unverified · 3 pointer-only (licence)
  Accurate depth estimation from images is a fundamental task in many applications including scene understanding and reconstruction.
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
  3 Jun 2014 42 repositories listed Syntology ran 10 of 22 samples · 12 unverified · 14 pointer-only (licence)
  In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN).
• Listen, Attend and Spell
  5 Aug 2015 40 repositories listed Syntology ran 12 of 51 samples · 39 unverified · 9 pointer-only (licence)
  Unlike traditional DNN-HMM models, this model learns all the components of a speech recognizer jointly.
• End-to-End Object Detection with Transformers
  26 May 2020 37 repositories listed Syntology ran 59 of 92 samples · 33 unverified · 19 pointer-only (licence)
  We present a new method that views object detection as a direct set prediction problem.
• Convolutional Sequence to Sequence Learning
  8 May 2017 37 repositories listed
  The prevalent approach to sequence to sequence learning maps an input sequence to a variable length output sequence via recurrent neural networks.
• Adversarial Autoencoders
  18 Nov 2015 29 repositories listed Syntology ran 8 of 12 samples · 4 unverified · 9 pointer-only (licence)
  In this paper, we propose the "adversarial autoencoder" (AAE), which is a probabilistic autoencoder that uses the recently proposed generative adversarial networks (GAN) to perform variational inference by matching the…
• SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
  31 May 2021 28 repositories listed Syntology ran 48 of 86 samples · 38 unverified · 15 pointer-only (licence)
  We present SegFormer, a simple, efficient yet powerful semantic segmentation framework which unifies Transformers with lightweight multilayer perception (MLP) decoders.
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
  26 Sep 2016 28 repositories listed Syntology ran 23 of 46 samples · 23 unverified · 12 pointer-only (licence)
  To improve parallelism and therefore decrease training time, our attention mechanism connects the bottom layer of the decoder to the top layer of the encoder.
• Modeling Relational Data with Graph Convolutional Networks
  17 Mar 2017 27 repositories listed Syntology ran 10 of 32 samples · 22 unverified · 15 pointer-only (licence)
  We demonstrate the effectiveness of R-GCNs as a stand-alone model for entity classification.
• Fast-SCNN: Fast Semantic Segmentation Network
  12 Feb 2019 24 repositories listed Syntology ran 0 of 32 samples · 32 unverified
  The encoder-decoder framework is state-of-the-art for offline semantic image segmentation.
• TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
  8 Feb 2021 22 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  Medical image segmentation is an essential prerequisite for developing healthcare systems, especially for disease diagnosis and treatment planning.
• Longformer: The Long-Document Transformer
  10 Apr 2020 22 repositories listed Syntology ran 15 of 35 samples · 20 unverified · 5 pointer-only (licence)
  To address this limitation, we introduce the Longformer with an attention mechanism that scales linearly with sequence length, making it easy to process documents of thousands of tokens or longer.
• FastSpeech: Fast, Robust and Controllable Text to Speech
  22 May 2019 22 repositories listed Syntology ran 3 of 11 samples · 8 unverified · 3 pointer-only (licence)
  In this work, we propose a novel feed-forward network based on Transformer to generate mel-spectrogram in parallel for TTS.
• Variational Graph Auto-Encoders
  21 Nov 2016 22 repositories listed Syntology ran 7 of 13 samples · 6 unverified
  We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE).
• Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding
  9 Nov 2015 21 repositories listed Syntology ran 0 of 18 samples · 18 unverified
  Semantic segmentation is an important tool for visual scene understanding and a meaningful measure of uncertainty is essential for decision making.
• PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
  18 Dec 2019 19 repositories listed Syntology ran 1 of 19 samples · 18 unverified
  Recent work pre-training Transformers with self-supervised objectives on large text corpora has shown great success when fine-tuned on downstream NLP tasks including text summarization.
• Text Summarization with Pretrained Encoders
  22 Aug 2019 19 repositories listed Syntology ran 7 of 21 samples · 14 unverified
  For abstractive summarization, we propose a new fine-tuning schedule which adopts different optimizers for the encoder and the decoder as a means of alleviating the mismatch between the two (the former is pretrained…
• Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
  6 Jul 2017 19 repositories listed Syntology ran 17 of 35 samples · 18 unverified · 15 pointer-only (licence)
  Spatiotemporal forecasting has various applications in neuroscience, climate and transportation domain.
• DN-DETR: Accelerate DETR Training by Introducing Query DeNoising
  2 Mar 2022 17 repositories listed Syntology ran 15 of 22 samples · 7 unverified · 9 pointer-only (licence)
  Our method is universal and can be easily plugged into any DETR-like methods by adding dozens of lines of code to achieve a remarkable improvement.
• Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning
  6 Dec 2016 17 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  The model decides whether to attend to the image and where, in order to extract meaningful information for sequential word generation.
• Sockeye: A Toolkit for Neural Machine Translation
  15 Dec 2017 16 repositories listed
  Written in Python and built on MXNet, the toolkit offers scalable training and inference for the three most prominent encoder-decoder architectures: attentional recurrent neural networks, self-attentional transformers,…
• Deep Koalarization: Image Colorization using CNNs and Inception-ResNet-v2
  9 Dec 2017 16 repositories listed
  We review some of the most recent approaches to colorize gray-scale images using deep learning methods.

Syntology lines on 27 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.