Methods › Natural Language Processing › Autoregressive Transformers › Transformer › Papers, page 121
Transformer
Papers archive 2025-07-28
archive papers tagged: 13,999 · with a code link: 6,572 · where Syntology ran a sample: 2,248 (1,919 with a run with no instrument failure, 329 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,248 of 13,999 tagged: 1,919 with a run with no instrument failure, 329 where every run was a failure of Syntology's instrument)
Page 121 of 140: papers 12,001 to 12,100 of 13,999, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Video Super-Resolution Transformer 12 Jun 2021 · 1 repository · arXiv:2106.06847
-
Break-It-Fix-It: Unsupervised Learning for Program Repair 11 Jun 2021 · 1 repository · arXiv:2106.06600Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Graph Transformer Networks: Learning Meta-path Graphs to Improve GNNs 11 Jun 2021 · 1 repository · arXiv:2106.06218
-
Isolated Sign Recognition from RGB Video using Pose Flow and Self-Attention 11 Jun 2021 · 1 repository
-
MlTr: Multi-label Classification with Transformer 11 Jun 2021 · 1 repository · arXiv:2106.06195
-
Modeling Sequences as Distributions with Uncertainty for Sequential Recommendation 11 Jun 2021 · 1 repository · arXiv:2106.06165
-
Neural Symbolic Regression that Scales 11 Jun 2021 · 2 repositories · arXiv:2106.06427Syntology official: harvested, nothing ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 7 harvested samples)
-
ViT-Inception-GAN for Image Colourising 11 Jun 2021 · 0 repositories · arXiv:2106.06321
-
CAT: Cross Attention in Vision Transformer 10 Jun 2021 · 1 repository · arXiv:2106.05786Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models 10 Jun 2021 · 1 repository · arXiv:2106.05505
-
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures 10 Jun 2021 · 0 repositories · arXiv:2106.05822
-
MST: Masked Self-Supervised Transformer for Visual Representation 10 Jun 2021 · 0 repositories · arXiv:2106.05656
-
Scaling Vision with Sparse Mixture of Experts 10 Jun 2021 · 1 repository · arXiv:2106.05974Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Space-time Mixing Attention for Video Transformer 10 Jun 2021 · 1 repository · arXiv:2106.05968Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
TASK AWARE MULTI-TASK LEARNING FOR SPEECH TO TEXT TASKS 10 Jun 2021 · 0 repositories
-
Do Transformers Really Perform Bad for Graph Representation? 9 Jun 2021 · 5 repositories · arXiv:2106.05234
-
Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding 9 Jun 2021 · 1 repository · arXiv:2106.04970Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer 9 Jun 2021 · 0 repositories · arXiv:2106.04833
-
Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time 9 Jun 2021 · 1 repository · arXiv:2106.05266
-
A Survey of Transformers 8 Jun 2021 · 2 repositories · arXiv:2106.04554
-
On the Connection between Local Attention and Dynamic Depth-wise Convolution 8 Jun 2021 · 1 repository · arXiv:2106.04263Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 1 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 9 pointer-only (licence)
-
DETReg: Unsupervised Pretraining with Region Priors for Object Detection 8 Jun 2021 · 1 repository · arXiv:2106.04550Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer 8 Jun 2021 · 0 repositories · arXiv:2106.04095
-
Fully Transformer Networks for Semantic Image Segmentation 8 Jun 2021 · 1 repository · arXiv:2106.04108
-
Hash Layers For Large Sparse Models 8 Jun 2021 · 0 repositories · arXiv:2106.04426
-
On the Lack of Robust Interpretability of Neural Text Classifiers 8 Jun 2021 · 0 repositories · arXiv:2106.04631
-
Scaling Vision Transformers 8 Jun 2021 · 1 repository · arXiv:2106.04560
-
Speech BERT Embedding For Improving Prosody in Neural TTS 8 Jun 2021 · 0 repositories · arXiv:2106.04312
-
Staircase Attention for Recurrent Processing of Sequences 8 Jun 2021 · 1 repository · arXiv:2106.04279
-
Attention Temperature Matters in Abstractive Summarization Distillation 7 Jun 2021 · 1 repository · arXiv:2106.03441
-
Person Re-Identification with a Locally Aware Transformer 7 Jun 2021 · 1 repository · arXiv:2106.03720Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Progressive Open-Domain Response Generation with Multiple Controllable Attributes 7 Jun 2021 · 0 repositories · arXiv:2106.14614
-
Rethinking Graph Transformers with Spectral Attention 7 Jun 2021 · 1 repository · arXiv:2106.03893
-
Reveal of Vision Transformers Robustness against Adversarial Attacks 7 Jun 2021 · 0 repositories · arXiv:2106.03734
-
Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer 7 Jun 2021 · 4 repositories · arXiv:2106.03650Syntology 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 6 pointer-only (licence)
-
Visual Transformer for Task-aware Active Learning 7 Jun 2021 · 1 repository · arXiv:2106.03801
-
ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias 7 Jun 2021 · 2 repositories · arXiv:2106.03348Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Attend and select: A segment selective transformer for microblog hashtag generation 6 Jun 2021 · 1 repository · arXiv:2106.03151
-
CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings 6 Jun 2021 · 1 repository · arXiv:2106.03143
-
Deep Source-Channel Coding for Sentence Semantic Transmission with HARQ 6 Jun 2021 · 0 repositories · arXiv:2106.03009
-
Oriented Object Detection with Transformer 6 Jun 2021 · 0 repositories · arXiv:2106.03146
-
Rethinking Training from Scratch for Object Detection 6 Jun 2021 · 1 repository · arXiv:2106.03112
-
Uformer: A General U-Shaped Transformer for Image Restoration 6 Jun 2021 · 4 repositories · arXiv:2106.03106Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding 5 Jun 2021 · 1 repository · arXiv:2106.02795Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Associating Objects with Transformers for Video Object Segmentation 4 Jun 2021 · 2 repositories · arXiv:2106.02638
-
Few-Shot Segmentation via Cycle-Consistent Transformer 4 Jun 2021 · 2 repositories · arXiv:2106.02320Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Glance-and-Gaze Vision Transformer 4 Jun 2021 · 1 repository · arXiv:2106.02277
-
Scalable Transformers for Neural Machine Translation 4 Jun 2021 · 0 repositories · arXiv:2106.02242
-
The Image Local Autoregressive Transformer 4 Jun 2021 · 1 repository · arXiv:2106.02514
-
A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer 3 Jun 2021 · 0 repositories · arXiv:2106.01927
-
An Improved Model for Voicing Silent Speech 3 Jun 2021 · 1 repository · arXiv:2106.01933
-
Anticipative Video Transformer 3 Jun 2021 · 1 repository · arXiv:2106.02036Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Defending Democracy: Using Deep Learning to Identify and Prevent Misinformation 3 Jun 2021 · 0 repositories · arXiv:2106.02607
-
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning 3 Jun 2021 · 0 repositories · arXiv:2106.01804
-
ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematics 3 Jun 2021 · 1 repository · arXiv:2106.01981
-
Offline Reinforcement Learning as One Big Sequence Modeling Problem 3 Jun 2021 · 2 repositories · arXiv:2106.02039Syntology official (archive's flag): 16 ran · 23 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 0 violated, 21 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 28 harvested samples) · 1 pointer-only (licence)
-
Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction 3 Jun 2021 · 1 repository · arXiv:2106.01609
-
Container: Context Aggregation Network 2 Jun 2021 · 4 repositories · arXiv:2106.01401Syntology official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Decision Transformer: Reinforcement Learning via Sequence Modeling 2 Jun 2021 · 20 repositories · arXiv:2106.01345Syntology community repositories only · 17 ran (of which 10 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 4 where Syntology's instrument failed) · 9 unverified (of 26 harvested samples) · 8 pointer-only (licence)
-
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization 2 Jun 2021 · 1 repository · arXiv:2106.01317Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling 2 Jun 2021 · 0 repositories · arXiv:2106.01040
-
IrEne: Interpretable Energy Prediction for Transformers 2 Jun 2021 · 1 repository · arXiv:2106.01199Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Solving Arithmetic Word Problems with Transformers and Preprocessing of Problem Text 2 Jun 2021 · 0 repositories · arXiv:2106.00893
-
SyGNS: A Systematic Generalization Testbed Based on Natural Language Semantics 2 Jun 2021 · 1 repository · arXiv:2106.01077
-
Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detection 2 Jun 2021 · 0 repositories · arXiv:2106.01071
-
Transformers are Deep Infinite-Dimensional Non-Mercer Binary Kernel Machines 2 Jun 2021 · 0 repositories · arXiv:2106.01506
-
TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification 2 Jun 2021 · 3 repositories · arXiv:2106.00908
-
Ad Headline Generation using Self-Critical Masked Language Model 1 Jun 2021 · 0 repositories
-
Comparing Test Sets with Item Response Theory 1 Jun 2021 · 0 repositories · arXiv:2106.00840
-
Contextual Domain Classification with Temporal Representations 1 Jun 2021 · 0 repositories
-
Cooperative Multi-Agent Transfer Learning with Level-Adaptive Credit Assignment 1 Jun 2021 · 0 repositories · arXiv:2106.00517
-
Cultural and Geographical Influences on Image Translatability of Words across Languages 1 Jun 2021 · 1 repository
-
Efficiently Summarizing Text and Graph Encodings of Multi-Document Clusters 1 Jun 2021 · 1 repository
-
Multi-Hop Transformer for Document-Level Machine Translation 1 Jun 2021 · 0 repositories
-
Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Information 1 Jun 2021 · 0 repositories · arXiv:2106.00559
-
Supervised Neural Clustering via Latent Structured Output Learning: Application to Question Intents 1 Jun 2021 · 1 repository
-
THG: Transformer with Hyperbolic Geometry 1 Jun 2021 · 0 repositories · arXiv:2106.07350
-
Too Much in Common: Shifting of Embeddings in Transformer Language Models and its Implications 1 Jun 2021 · 1 repository
-
Towards Modeling the Style of Translators in Neural Machine Translation 1 Jun 2021 · 0 repositories
-
You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection 1 Jun 2021 · 2 repositories · arXiv:2106.00666Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples) · 5 pointer-only (licence)
-
Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model 31 May 2021 · 1 repository · arXiv:2105.15089
-
Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation 31 May 2021 · 2 repositories · arXiv:2105.15087
-
Cascaded Head-colliding Attention 31 May 2021 · 1 repository · arXiv:2105.14850Syntology official (archive's flag): 3 ran · 9 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 5 pointer-only (licence)
-
Choose a Transformer: Fourier or Galerkin 31 May 2021 · 1 repository · arXiv:2105.14995Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
M6-T: Exploring Sparse Expert Models and Beyond 31 May 2021 · 0 repositories · arXiv:2105.15082
-
G-Transformer for Document-level Machine Translation 31 May 2021 · 1 repository · arXiv:2105.14761Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognition 31 May 2021 · 2 repositories · arXiv:2105.15075Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers 31 May 2021 · 28 repositories · arXiv:2105.15203Syntology official: no sample here; runs from other or unrecorded repositories · 66 ran (of which 22 constructed an object rather than computing a result; 62 with no instrument failure: 0 honoured, 1 violated, 61 with no contract checked; 4 where Syntology's instrument failed) · 20 unverified (of 86 harvested samples) · 20 pointer-only (licence)
-
Neural Models for Offensive Language Detection 30 May 2021 · 0 repositories · arXiv:2106.14609
-
TransMatcher: Deep Image Matching Through Transformers for Generalizable Person Re-identification 30 May 2021 · 2 repositories · arXiv:2105.14432Syntology official (archive's flag): 5 ran · 13 ran (of which 4 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 21 harvested samples) · 1 pointer-only (licence)
-
Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video 30 May 2021 · 1 repository · arXiv:2105.14520
-
FoveaTer: Foveated Transformer for Image Classification 29 May 2021 · 0 repositories · arXiv:2105.14173
-
Korean-English Machine Translation with Multiple Tokenization Strategy 29 May 2021 · 1 repository · arXiv:2105.14274
-
Less is More: Pay Less Attention in Vision Transformers 29 May 2021 · 2 repositories · arXiv:2105.14217
-
M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformers 29 May 2021 · 0 repositories · arXiv:2105.14211
-
An Attention Free Transformer 28 May 2021 · 11 repositories · arXiv:2105.14103Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
ByT5: Towards a token-free future with pre-trained byte-to-byte models 28 May 2021 · 5 repositories · arXiv:2105.13626Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
Compositionally restricted attention-based network for materials property predictions 28 May 2021 · 1 repository
-
Hierarchical Transformer Encoders for Vietnamese Spelling Correction 28 May 2021 · 1 repository · arXiv:2105.13578
-
PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer 28 May 2021 · 1 repository · arXiv:2105.13993