Methods › General › Position Embeddings › Absolute Position Encodings › Papers, page 122
Absolute Position Encodings
Papers archive 2025-07-28
archive papers tagged: 13,942 · with a code link: 6,505 · where Syntology ran a sample: 2,224 (1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,224 of 13,942 tagged: 1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 122 of 140: papers 12,101 to 12,200 of 13,942, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
EL-Attention: Memory Efficient Lossless Attention for Generation 11 May 2021 · 1 repository · arXiv:2105.04779Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Learning Robust Latent Representations for Controllable Speech Synthesis 10 May 2021 · 0 repositories · arXiv:2105.04458
-
Matching Visual Features to Hierarchical Semantic Topics for Image Paragraph Captioning 10 May 2021 · 1 repository · arXiv:2105.04143
-
MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAE 10 May 2021 · 1 repository · arXiv:2105.04090Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey 10 May 2021 · 0 repositories · arXiv:2105.04387
-
RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representation 10 May 2021 · 0 repositories · arXiv:2105.04322
-
Self-Guided Curriculum Learning for Neural Machine Translation 10 May 2021 · 0 repositories · arXiv:2105.04475
-
Self-Supervised Learning with Swin Transformers 10 May 2021 · 6 repositories · arXiv:2105.04553
-
FNet: Mixing Tokens with Fourier Transforms 9 May 2021 · 12 repositories · arXiv:2105.03824Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
TrTr: Visual Tracking with Transformer 9 May 2021 · 1 repository · arXiv:2105.03817
-
Which transformer architecture fits my data? A vocabulary bottleneck in self-attention 9 May 2021 · 0 repositories · arXiv:2105.03928
-
Falling Through the Gaps: Neural Architectures as Models of Morphological Rule Learning 8 May 2021 · 1 repository · arXiv:2105.03710
-
Are Pre-trained Convolutions Better than Pre-trained Transformers? 7 May 2021 · 1 repository · arXiv:2105.03322
-
Efficient Weight factorization for Multilingual Speech Recognition 7 May 2021 · 0 repositories · arXiv:2105.03010
-
MOTR: End-to-End Multiple-Object Tracking with Transformer 7 May 2021 · 2 repositories · arXiv:2105.03247
-
SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts 7 May 2021 · 1 repository · arXiv:2105.03036
-
Adapting Monolingual Models: Data can be Scarce when Language Similarity is High 6 May 2021 · 1 repository · arXiv:2105.02855
-
Aligning Subtitles in Sign Language Videos 6 May 2021 · 0 repositories · arXiv:2105.02877
-
On the logistical difficulties and findings of Jopara Sentiment Analysis 6 May 2021 · 1 repository · arXiv:2105.02947
-
Attention for Image Registration (AiR): an unsupervised Transformer approach 5 May 2021 · 1 repository · arXiv:2105.02282
-
Instances as Queries 5 May 2021 · 5 repositories · arXiv:2105.01928Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Encoding Weights of Irregular Sparsity for Fixed-to-Fixed Model Compression 5 May 2021 · 0 repositories · arXiv:2105.01869
-
Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queries 5 May 2021 · 0 repositories · arXiv:2105.02170
-
MLP-Mixer: An all-MLP Architecture for Vision 4 May 2021 · 49 repositories · arXiv:2105.01601Syntology official: harvested, nothing ran · 114 ran (of which 77 constructed an object rather than computing a result; 105 with no instrument failure: 2 honoured, 0 violated, 103 with no contract checked; 9 where Syntology's instrument failed) · 20 unverified (of 134 harvested samples) · 40 pointer-only (licence)
-
Moving Towards Centers: Re-ranking with Attention and Memory for Re-identification 4 May 2021 · 0 repositories · arXiv:2105.01447
-
Retrieving Complex Tables with Multi-Granular Graph Representation Learning 4 May 2021 · 1 repository · arXiv:2105.01736Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
ISTR: End-to-End Instance Segmentation with Transformers 3 May 2021 · 1 repository · arXiv:2105.00637
-
AGMB-Transformer: Anatomy-Guided Multi-Branch Transformer Network for Automated Evaluation of Root Canal Therapy 2 May 2021 · 1 repository · arXiv:2105.00381
-
Audio Transformers 1 May 2021 · 0 repositories · arXiv:2105.00335
-
Incorporating Transformer and LSTM to Kalman Filter with EM algorithm for state estimation 1 May 2021 · 1 repository · arXiv:2105.00250
-
SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognition 1 May 2021 · 0 repositories · arXiv:2105.00149
-
CAT: Cross-Attention Transformer for One-Shot Object Detection 30 Apr 2021 · 0 repositories · arXiv:2104.14984
-
Chop Chop BERT: Visual Question Answering by Chopping VisualBERT's Heads 30 Apr 2021 · 0 repositories · arXiv:2104.14741
-
CoSformer: Detecting Co-Salient Object with Transformers 30 Apr 2021 · 0 repositories · arXiv:2104.14729
-
GTN-ED: Event Detection Using Graph Transformer Networks 30 Apr 2021 · 0 repositories · arXiv:2104.15104
-
AMR Parsing with Action-Pointer Transformer 29 Apr 2021 · 1 repository · arXiv:2104.14674Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Emerging Properties in Self-Supervised Vision Transformers 29 Apr 2021 · 32 repositories · arXiv:2104.14294Syntology official: no sample here; runs from other or unrecorded repositories · 14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 20 harvested samples) · 4 pointer-only (licence)
-
GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathological Image Detection 29 Apr 2021 · 0 repositories · arXiv:2104.14528
-
Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation 29 Apr 2021 · 1 repository · arXiv:2104.14639
-
Pyramid Medical Transformer for Medical Image Segmentation 29 Apr 2021 · 0 repositories · arXiv:2104.14702
-
Using Adaptive Gradient for Texture Learning in Single-View 3D Reconstruction 29 Apr 2021 · 0 repositories · arXiv:2104.14169
-
Inpainting Transformer for Anomaly Detection 28 Apr 2021 · 2 repositories · arXiv:2104.13897Syntology 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Medical Transformer: Universal Brain Encoder for 3D MRI Analysis 28 Apr 2021 · 0 repositories · arXiv:2104.13633
-
Point Cloud Learning with Transformer 28 Apr 2021 · 0 repositories · arXiv:2104.13636
-
Dual Transformer for Point Cloud Analysis 27 Apr 2021 · 0 repositories · arXiv:2104.13044
-
Generating Lead Sheets with Affect: A Novel Conditional seq2seq Framework 27 Apr 2021 · 1 repository · arXiv:2104.13056
-
Accounting for Agreement Phenomena in Sentence Comprehension with Transformer Language Models: Effects of Similarity-based Interference on Surprisal and Attention 26 Apr 2021 · 0 repositories · arXiv:2104.12874
-
Easy and Efficient Transformer : Scalable Inference Solution For large NLP model 26 Apr 2021 · 1 repository · arXiv:2104.12470
-
Head-synchronous Decoding for Transformer-based Streaming ASR 26 Apr 2021 · 0 repositories · arXiv:2104.12631
-
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding 26 Apr 2021 · 5 repositories · arXiv:2104.12763Syntology community repositories only · 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
-
PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation 26 Apr 2021 · 5 repositories · arXiv:2104.12369
-
Rich Semantics Improve Few-shot Learning 26 Apr 2021 · 0 repositories · arXiv:2104.12709
-
Visformer: The Vision-friendly Transformer 26 Apr 2021 · 5 repositories · arXiv:2104.12533Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images 25 Apr 2021 · 1 repository · arXiv:2104.12137Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Visual Saliency Transformer 25 Apr 2021 · 2 repositories · arXiv:2104.12099Syntology 7 ran (of which 4 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
baller2vec++: A Look-Ahead Multi-Entity Transformer For Modeling Coordinated Agents 24 Apr 2021 · 1 repository · arXiv:2104.11980Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
Learning to Cluster Faces via Transformer 23 Apr 2021 · 0 repositories · arXiv:2104.11502
-
VidTr: Video Transformer Without Convolutions 23 Apr 2021 · 0 repositories · arXiv:2104.11746
-
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text 22 Apr 2021 · 5 repositories · arXiv:2104.11178Syntology community repositories only · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Carbon Emissions and Large Neural Network Training 21 Apr 2021 · 0 repositories · arXiv:2104.10350
-
Label-Synchronous Speech-to-Text Alignment for ASR Using Forward and Backward Transformers 21 Apr 2021 · 0 repositories · arXiv:2104.10328
-
Efficient pre-training objectives for Transformers 20 Apr 2021 · 0 repositories · arXiv:2104.09694
-
Modeling Event Plausibility with Consistent Conceptual Abstraction 20 Apr 2021 · 1 repository · arXiv:2104.10247Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings 19 Apr 2021 · 0 repositories · arXiv:2104.09079
-
Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers 19 Apr 2021 · 0 repositories · arXiv:2104.09426
-
Code Structure Guided Transformer for Source Code Summarization 19 Apr 2021 · 0 repositories · arXiv:2104.09340
-
Extracting Temporal Event Relation with Syntax-guided Graph Transformer 19 Apr 2021 · 1 repository · arXiv:2104.09570
-
Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence 19 Apr 2021 · 0 repositories · arXiv:2104.09393
-
Multi-Modal Fusion Transformer for End-to-End Autonomous Driving 19 Apr 2021 · 2 repositories · arXiv:2104.09224Syntology official (archive's flag): 3 ran · 9 ran (of which 7 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 15 harvested samples)
-
TransCrowd: weakly-supervised crowd counting with transformers 19 Apr 2021 · 1 repository · arXiv:2104.09116
-
Attention-based Clinical Note Summarization 18 Apr 2021 · 1 repository · arXiv:2104.08942
-
A Simple and Effective Positional Encoding for Transformers 18 Apr 2021 · 0 repositories · arXiv:2104.08698
-
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks 18 Apr 2021 · 1 repository · arXiv:2104.08815
-
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs 18 Apr 2021 · 2 repositories · arXiv:2104.08692
-
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation 18 Apr 2021 · 1 repository · arXiv:2104.08771Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset 18 Apr 2021 · 2 repositories · arXiv:2104.08671Syntology official (archive's flag): 1 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples)
-
Three-level Hierarchical Transformer Networks for Long-sequence and Multiple Clinical Documents Classification 17 Apr 2021 · 1 repository · arXiv:2104.08444
-
Higher Order Recurrent Space-Time Transformer for Video Action Prediction 17 Apr 2021 · 1 repository · arXiv:2104.08665
-
Vision Transformer Pruning 17 Apr 2021 · 2 repositories · arXiv:2104.08500Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Comparison of Grammatical Error Correction Using Back-Translation Models 16 Apr 2021 · 0 repositories · arXiv:2104.07848
-
Condenser: a Pre-training Architecture for Dense Retrieval 16 Apr 2021 · 1 repository · arXiv:2104.08253Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 3 harvested samples)
-
Counter-Interference Adapter for Multilingual Machine Translation 16 Apr 2021 · 1 repository · arXiv:2104.08154
-
Adaptive Sparse Transformer for Multilingual Translation 15 Apr 2021 · 0 repositories · arXiv:2104.07358
-
Cross-domain Speech Recognition with Unsupervised Character-level Distribution Matching 15 Apr 2021 · 1 repository · arXiv:2104.07491
-
Robust Optimization for Multilingual Translation with Imbalanced Data 15 Apr 2021 · 0 repositories · arXiv:2104.07639
-
Points as Queries: Weakly Semi-supervised Object Detection by Points 15 Apr 2021 · 1 repository · arXiv:2104.07434Syntology 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Rethinking Text Line Recognition Models 15 Apr 2021 · 0 repositories · arXiv:2104.07787
-
Self-supervised Video Object Segmentation by Motion Grouping 15 Apr 2021 · 0 repositories · arXiv:2104.07658
-
Shoulder Implant X-Ray Manufacturer Classification: Exploring with Vision Transformer 15 Apr 2021 · 1 repository · arXiv:2104.07667
-
Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling 15 Apr 2021 · 0 repositories · arXiv:2104.07704
-
TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction 15 Apr 2021 · 1 repository · arXiv:2104.07244
-
Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification 15 Apr 2021 · 0 repositories · arXiv:2104.07235
-
An Introduction of mini-AlphaStar 14 Apr 2021 · 1 repository · arXiv:2104.06890
-
Decoupled Spatial-Temporal Transformer for Video Inpainting 14 Apr 2021 · 1 repository · arXiv:2104.06637
-
Knowledge-driven Answer Generation for Conversational Search 14 Apr 2021 · 0 repositories · arXiv:2104.06892
-
NAREOR: The Narrative Reordering Problem 14 Apr 2021 · 1 repository · arXiv:2104.06669
-
Non-autoregressive sequence-to-sequence voice conversion 14 Apr 2021 · 0 repositories · arXiv:2104.06793
-
Sparse Attention with Linear Units 14 Apr 2021 · 3 repositories · arXiv:2104.07012Syntology official: harvested, nothing ran · 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
TWEAC: Transformer with Extendable QA Agent Classifiers 14 Apr 2021 · 1 repository · arXiv:2104.07081
-
Can a Transformer Pass the Wug Test? Tuning Copying Bias in Neural Morphological Inflection Models 13 Apr 2021 · 0 repositories · arXiv:2104.06483