Methods › General › Position Embeddings › Absolute Position Encodings › Papers, page 120
Absolute Position Encodings
Papers archive 2025-07-28
archive papers tagged: 13,942 · with a code link: 6,505 · where Syntology ran a sample: 2,224 (1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,224 of 13,942 tagged: 1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 120 of 140: papers 11,901 to 12,000 of 13,942, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Revisiting Deep Learning Models for Tabular Data 22 Jun 2021 · 11 repositories · arXiv:2106.11959Syntology official (archive's flag): 10 ran · 18 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 1 violated, 14 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 22 harvested samples) · 1 pointer-only (licence)
-
Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records 21 Jun 2021 · 0 repositories · arXiv:2106.11360
-
MODETR: Moving Object Detection with Transformers 21 Jun 2021 · 0 repositories · arXiv:2106.11422
-
TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning 21 Jun 2021 · 0 repositories · arXiv:2106.10936
-
CPM-2: Large-scale Cost-effective Pre-trained Language Models 20 Jun 2021 · 2 repositories · arXiv:2106.10715
-
Solution for Large-scale Long-tailed Recognition with Noisy Labels 20 Jun 2021 · 1 repository · arXiv:2106.10683
-
Adaptive Image Transformer for One-Shot Object Detection 19 Jun 2021 · 0 repositories
-
Clusformer: A Transformer Based Clustering Approach to Unsupervised Large-Scale Face and Visual Landmark Recognition 19 Jun 2021 · 1 repository
-
Exploring Vision Transformers for Fine-grained Classification 19 Jun 2021 · 1 repository · arXiv:2106.10587
-
Gaussian Context Transformer 19 Jun 2021 · 0 repositories
-
Improving Compositional Generalization in Classification Tasks via Structure Annotations 19 Jun 2021 · 0 repositories · arXiv:2106.10434
-
JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs 19 Jun 2021 · 1 repository · arXiv:2106.10502
-
Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos 19 Jun 2021 · 1 repository
-
RSTNet: Captioning With Adaptive Attention on Visual and Non-Visual Words 19 Jun 2021 · 1 repository
-
All You Can Embed: Natural Language based Vehicle Retrieval with Spatio-Temporal Transformers 18 Jun 2021 · 1 repository · arXiv:2106.10153
-
Anomaly Detection in Dynamic Graphs via Transformer 18 Jun 2021 · 1 repository · arXiv:2106.09876Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
End-to-end Temporal Action Detection with Transformer 18 Jun 2021 · 1 repository · arXiv:2106.10271Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Recurrent Stacking of Layers in Neural Networks: An Application to Neural Machine Translation 18 Jun 2021 · 0 repositories · arXiv:2106.10002
-
Dual-view Molecule Pre-training 17 Jun 2021 · 1 repository · arXiv:2106.10234
-
Long-Short Temporal Contrastive Learning of Video Transformers 17 Jun 2021 · 0 repositories · arXiv:2106.09212
-
LoRA: Low-Rank Adaptation of Large Language Models 17 Jun 2021 · 74 repositories · arXiv:2106.09685Syntology community repositories only · 51 ran (of which 19 constructed an object rather than computing a result; 44 with no instrument failure: 1 honoured, 0 violated, 43 with no contract checked; 7 where Syntology's instrument failed) · 33 unverified (of 84 harvested samples) · 30 pointer-only (licence)
-
Multi-head or Single-head? An Empirical Comparison for Transformer Training 17 Jun 2021 · 1 repository · arXiv:2106.09650
-
Semi-Autoregressive Transformer for Image Captioning 17 Jun 2021 · 1 repository · arXiv:2106.09436
-
SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interaction 17 Jun 2021 · 6 repositories · arXiv:2106.09305Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples)
-
End-to-End Semi-Supervised Object Detection with Soft Teacher 16 Jun 2021 · 8 repositories · arXiv:2106.09018
-
Grounding Spatio-Temporal Language with Transformers 16 Jun 2021 · 1 repository · arXiv:2106.08858
-
On Evaluation and Improvement of Tail Label Performance for Multi-label Text Classification 16 Jun 2021 · 0 repositories
-
Shuffle Transformer with Feature Alignment for Video Face Parsing 16 Jun 2021 · 0 repositories · arXiv:2106.08650
-
Masked Training of Neural Networks with Partial Gradients 16 Jun 2021 · 0 repositories · arXiv:2106.08895
-
BEiT: BERT Pre-Training of Image Transformers 15 Jun 2021 · 14 repositories · arXiv:2106.08254Syntology official (archive's flag): 1 ran · 6 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
PairConnect: A Compute-Efficient MLP Alternative to Attention 15 Jun 2021 · 0 repositories · arXiv:2106.08235
-
Scene Transformer: A unified architecture for predicting multiple agent trajectories 15 Jun 2021 · 4 repositories · arXiv:2106.08417Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
End-to-end Neural Diarization: From Transformer to Conformer 14 Jun 2021 · 0 repositories · arXiv:2106.07167
-
Improved Transformer for High-Resolution GANs 14 Jun 2021 · 1 repository · arXiv:2106.07631Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
NG+ : A Multi-Step Matrix-Product Natural Gradient Method for Deep Learning 14 Jun 2021 · 1 repository · arXiv:2106.07454
-
S²-MLP: Spatial-Shift MLP Architecture for Vision 14 Jun 2021 · 1 repository · arXiv:2106.07477
-
Why Can You Lay Off Heads? Investigating How BERT Heads Transfer 14 Jun 2021 · 0 repositories · arXiv:2106.07137
-
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping 13 Jun 2021 · 0 repositories · arXiv:2106.06905
-
Reinforcement Learning as One Big Sequence Modeling Problem 13 Jun 2021 · 1 repository
-
The DEformer: An Order-Agnostic Distribution Estimating Transformer 13 Jun 2021 · 1 repository · arXiv:2106.06989Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Thinking Like Transformers 13 Jun 2021 · 5 repositories · arXiv:2106.06981Syntology official (archive's flag): 5 ran · 11 ran (of which 3 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 1 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 18 harvested samples) · 5 pointer-only (licence)
-
Curriculum Pre-Training Heterogeneous Subgraph Transformer for Top-N Recommendation 12 Jun 2021 · 0 repositories · arXiv:2106.06722
-
DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentation 12 Jun 2021 · 1 repository · arXiv:2106.06716Syntology official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Video Super-Resolution Transformer 12 Jun 2021 · 1 repository · arXiv:2106.06847
-
Break-It-Fix-It: Unsupervised Learning for Program Repair 11 Jun 2021 · 1 repository · arXiv:2106.06600Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Graph Transformer Networks: Learning Meta-path Graphs to Improve GNNs 11 Jun 2021 · 1 repository · arXiv:2106.06218
-
Isolated Sign Recognition from RGB Video using Pose Flow and Self-Attention 11 Jun 2021 · 1 repository
-
MlTr: Multi-label Classification with Transformer 11 Jun 2021 · 1 repository · arXiv:2106.06195
-
Modeling Sequences as Distributions with Uncertainty for Sequential Recommendation 11 Jun 2021 · 1 repository · arXiv:2106.06165
-
Neural Symbolic Regression that Scales 11 Jun 2021 · 2 repositories · arXiv:2106.06427Syntology official: harvested, nothing ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 7 harvested samples)
-
ViT-Inception-GAN for Image Colourising 11 Jun 2021 · 0 repositories · arXiv:2106.06321
-
CAT: Cross Attention in Vision Transformer 10 Jun 2021 · 1 repository · arXiv:2106.05786Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models 10 Jun 2021 · 1 repository · arXiv:2106.05505
-
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures 10 Jun 2021 · 0 repositories · arXiv:2106.05822
-
MST: Masked Self-Supervised Transformer for Visual Representation 10 Jun 2021 · 0 repositories · arXiv:2106.05656
-
Scaling Vision with Sparse Mixture of Experts 10 Jun 2021 · 1 repository · arXiv:2106.05974Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Space-time Mixing Attention for Video Transformer 10 Jun 2021 · 1 repository · arXiv:2106.05968Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
TASK AWARE MULTI-TASK LEARNING FOR SPEECH TO TEXT TASKS 10 Jun 2021 · 0 repositories
-
Do Transformers Really Perform Bad for Graph Representation? 9 Jun 2021 · 5 repositories · arXiv:2106.05234
-
Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding 9 Jun 2021 · 1 repository · arXiv:2106.04970Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer 9 Jun 2021 · 0 repositories · arXiv:2106.04833
-
Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time 9 Jun 2021 · 1 repository · arXiv:2106.05266
-
A Survey of Transformers 8 Jun 2021 · 2 repositories · arXiv:2106.04554
-
On the Connection between Local Attention and Dynamic Depth-wise Convolution 8 Jun 2021 · 1 repository · arXiv:2106.04263Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 1 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 9 pointer-only (licence)
-
DETReg: Unsupervised Pretraining with Region Priors for Object Detection 8 Jun 2021 · 1 repository · arXiv:2106.04550Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer 8 Jun 2021 · 0 repositories · arXiv:2106.04095
-
Fully Transformer Networks for Semantic Image Segmentation 8 Jun 2021 · 1 repository · arXiv:2106.04108
-
Hash Layers For Large Sparse Models 8 Jun 2021 · 0 repositories · arXiv:2106.04426
-
On the Lack of Robust Interpretability of Neural Text Classifiers 8 Jun 2021 · 0 repositories · arXiv:2106.04631
-
Scaling Vision Transformers 8 Jun 2021 · 1 repository · arXiv:2106.04560
-
Speech BERT Embedding For Improving Prosody in Neural TTS 8 Jun 2021 · 0 repositories · arXiv:2106.04312
-
Staircase Attention for Recurrent Processing of Sequences 8 Jun 2021 · 1 repository · arXiv:2106.04279
-
Attention Temperature Matters in Abstractive Summarization Distillation 7 Jun 2021 · 1 repository · arXiv:2106.03441
-
Person Re-Identification with a Locally Aware Transformer 7 Jun 2021 · 1 repository · arXiv:2106.03720Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Progressive Open-Domain Response Generation with Multiple Controllable Attributes 7 Jun 2021 · 0 repositories · arXiv:2106.14614
-
Rethinking Graph Transformers with Spectral Attention 7 Jun 2021 · 1 repository · arXiv:2106.03893
-
Reveal of Vision Transformers Robustness against Adversarial Attacks 7 Jun 2021 · 0 repositories · arXiv:2106.03734
-
Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer 7 Jun 2021 · 4 repositories · arXiv:2106.03650Syntology 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 6 pointer-only (licence)
-
Visual Transformer for Task-aware Active Learning 7 Jun 2021 · 1 repository · arXiv:2106.03801
-
ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias 7 Jun 2021 · 2 repositories · arXiv:2106.03348Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Attend and select: A segment selective transformer for microblog hashtag generation 6 Jun 2021 · 1 repository · arXiv:2106.03151
-
CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings 6 Jun 2021 · 1 repository · arXiv:2106.03143
-
Deep Source-Channel Coding for Sentence Semantic Transmission with HARQ 6 Jun 2021 · 0 repositories · arXiv:2106.03009
-
Oriented Object Detection with Transformer 6 Jun 2021 · 0 repositories · arXiv:2106.03146
-
Rethinking Training from Scratch for Object Detection 6 Jun 2021 · 1 repository · arXiv:2106.03112
-
Uformer: A General U-Shaped Transformer for Image Restoration 6 Jun 2021 · 4 repositories · arXiv:2106.03106Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding 5 Jun 2021 · 1 repository · arXiv:2106.02795Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Associating Objects with Transformers for Video Object Segmentation 4 Jun 2021 · 2 repositories · arXiv:2106.02638
-
Few-Shot Segmentation via Cycle-Consistent Transformer 4 Jun 2021 · 2 repositories · arXiv:2106.02320Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Glance-and-Gaze Vision Transformer 4 Jun 2021 · 1 repository · arXiv:2106.02277
-
Scalable Transformers for Neural Machine Translation 4 Jun 2021 · 0 repositories · arXiv:2106.02242
-
The Image Local Autoregressive Transformer 4 Jun 2021 · 1 repository · arXiv:2106.02514
-
A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer 3 Jun 2021 · 0 repositories · arXiv:2106.01927
-
An Improved Model for Voicing Silent Speech 3 Jun 2021 · 1 repository · arXiv:2106.01933
-
Anticipative Video Transformer 3 Jun 2021 · 1 repository · arXiv:2106.02036Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Defending Democracy: Using Deep Learning to Identify and Prevent Misinformation 3 Jun 2021 · 0 repositories · arXiv:2106.02607
-
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning 3 Jun 2021 · 0 repositories · arXiv:2106.01804
-
ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematics 3 Jun 2021 · 1 repository · arXiv:2106.01981
-
Offline Reinforcement Learning as One Big Sequence Modeling Problem 3 Jun 2021 · 2 repositories · arXiv:2106.02039Syntology official (archive's flag): 16 ran · 23 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 0 violated, 21 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 28 harvested samples) · 1 pointer-only (licence)
-
Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction 3 Jun 2021 · 1 repository · arXiv:2106.01609