Methods › General › Position Embeddings › Absolute Position Encodings › Papers, page 109
Absolute Position Encodings
Papers archive 2025-07-28
archive papers tagged: 13,942 · with a code link: 6,505 · where Syntology ran a sample: 2,224 (1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,224 of 13,942 tagged: 1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 109 of 140: papers 10,801 to 10,900 of 13,942, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
openFEAT: Improving Speaker Identification by Open-set Few-shot Embedding Adaptation with Transformer 24 Feb 2022 · 0 repositories · arXiv:2202.12349
-
Transformers in Medical Image Analysis: A Review 24 Feb 2022 · 0 repositories · arXiv:2202.12165
-
A Differential Attention Fusion Model Based on Transformer for Time Series Forecasting 23 Feb 2022 · 0 repositories · arXiv:2202.11402
-
FastRPB: a Scalable Relative Positional Encoding for Long Sequence Tasks 23 Feb 2022 · 1 repository · arXiv:2202.11364
-
Paying U-Attention to Textures: Multi-Stage Hourglass Vision Transformer for Universal Texture Synthesis 23 Feb 2022 · 0 repositories · arXiv:2202.11703
-
Refining the state-of-the-art in Machine Translation, optimizing NMT for the JA <-> EN language pair by leveraging personal domain expertise 23 Feb 2022 · 0 repositories · arXiv:2202.11669
-
Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation 23 Feb 2022 · 1 repository · arXiv:2202.11742Syntology 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
A New Generation of Perspective API: Efficient Multilingual Character-level Transformers 22 Feb 2022 · 0 repositories · arXiv:2202.11176
-
GroupViT: Semantic Segmentation Emerges from Text Supervision 22 Feb 2022 · 6 repositories · arXiv:2202.11094
-
One-shot Scene Graph Generation 22 Feb 2022 · 1 repository · arXiv:2202.10824
-
Social Computational Design Method for Generating Product Shapes with GAN and Transformer Models 22 Feb 2022 · 0 repositories · arXiv:2202.10774
-
Socialformer: Social Network Inspired Long Document Modeling for Document Ranking 22 Feb 2022 · 1 repository · arXiv:2202.10870
-
Embarrassingly Simple Performance Prediction for Abductive Natural Language Inference 21 Feb 2022 · 1 repository · arXiv:2202.10408
-
Rethinking the Zigzag Flattening for Image Reading 21 Feb 2022 · 0 repositories · arXiv:2202.10240
-
S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification 21 Feb 2022 · 1 repository · arXiv:2202.10139
-
ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond 21 Feb 2022 · 8 repositories · arXiv:2202.10108Syntology community repositories only · 22 ran (of which 8 constructed an object rather than computing a result; 16 with no instrument failure: 0 honoured, 0 violated, 16 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 25 harvested samples) · 4 pointer-only (licence)
-
ARM3D: Attention-based relation module for indoor 3D object detection 20 Feb 2022 · 1 repository · arXiv:2202.09715
-
Do Transformers know symbolic rules, and would we know if they did? 19 Feb 2022 · 0 repositories · arXiv:2203.00162
-
TransDreamer: Reinforcement Learning with Transformer World Models 19 Feb 2022 · 0 repositories · arXiv:2202.09481Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
A Survey of Vision-Language Pre-Trained Models 18 Feb 2022 · 0 repositories · arXiv:2202.10936
-
Mixture-of-Experts with Expert Choice Routing 18 Feb 2022 · 0 repositories · arXiv:2202.09368
-
Task Specific Attention is one more thing you need for object detection 18 Feb 2022 · 1 repository · arXiv:2202.09048
-
Unleashing the Power of Transformer for Graphs 18 Feb 2022 · 0 repositories · arXiv:2202.10581
-
Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatment 17 Feb 2022 · 0 repositories · arXiv:2202.08510
-
ST-MoE: Designing Stable and Transferable Sparse Expert Models 17 Feb 2022 · 3 repositories · arXiv:2202.08906Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Graph Masked Autoencoders with Transformers 17 Feb 2022 · 1 repository · arXiv:2202.08391
-
Improving English to Sinhala Neural Machine Translation using Part-of-Speech Tag 17 Feb 2022 · 0 repositories · arXiv:2202.08882
-
Revisiting Over-smoothing in BERT from the Perspective of Graph 17 Feb 2022 · 0 repositories · arXiv:2202.08625
-
Transformer for Graphs: An Overview from Architecture Perspective 17 Feb 2022 · 1 repository · arXiv:2202.08455Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
TraSeTR: Track-to-Segment Transformer with Contrastive Query for Instance-level Instrument Segmentation in Robotic Surgery 17 Feb 2022 · 0 repositories · arXiv:2202.08453
-
ActionFormer: Localizing Moments of Actions with Transformers 16 Feb 2022 · 1 repository · arXiv:2202.07925
-
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation 16 Feb 2022 · 1 repository · arXiv:2202.07959Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
The NLP Task Effectiveness of Long-Range Transformers 16 Feb 2022 · 0 repositories · arXiv:2202.07856
-
A Survey on Dynamic Neural Networks for Natural Language Processing 15 Feb 2022 · 0 repositories · arXiv:2202.07101
-
A Survey on Model Compression and Acceleration for Pretrained Language Models 15 Feb 2022 · 0 repositories · arXiv:2202.07105
-
Personalized Prompt Learning for Explainable Recommendation 15 Feb 2022 · 1 repository · arXiv:2202.07371
-
Transformers in Time Series: A Survey 15 Feb 2022 · 11 repositories · arXiv:2202.07125
-
ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformer 15 Feb 2022 · 0 repositories · arXiv:2202.07305
-
XAI for Transformers: Better Explanations through Conservative Propagation 15 Feb 2022 · 1 repository · arXiv:2202.07304Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples)
-
CodeFill: Multi-token Code Completion by Jointly Learning from Structure and Naming Sequences 14 Feb 2022 · 1 repository · arXiv:2202.06689
-
Geometric Transformer for Fast and Robust Point Cloud Registration 14 Feb 2022 · 2 repositories · arXiv:2202.06688Syntology community repositories only · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 9 harvested samples) · 9 pointer-only (licence)
-
Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Images 14 Feb 2022 · 1 repository · arXiv:2202.07001Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs 14 Feb 2022 · 2 repositories · arXiv:2202.06510Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 6 pointer-only (licence)
-
Source Code Summarization with Structural Relative Position Guided Transformer 14 Feb 2022 · 1 repository · arXiv:2202.06521
-
Transformer Memory as a Differentiable Search Index 14 Feb 2022 · 1 repository · arXiv:2202.06991
-
What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code 14 Feb 2022 · 1 repository · arXiv:2202.06840
-
BViT: Broad Attention based Vision Transformer 13 Feb 2022 · 1 repository · arXiv:2202.06268
-
ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification 13 Feb 2022 · 1 repository · arXiv:2202.06335
-
LighTN: Light-weight Transformer Network for Performance-overhead Tradeoff in Point Cloud Downsampling 13 Feb 2022 · 0 repositories · arXiv:2202.06263
-
LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognition 13 Feb 2022 · 0 repositories · arXiv:2203.03546
-
Benchmark Assessment for DeepSpeed Optimization Library 12 Feb 2022 · 0 repositories · arXiv:2202.12831
-
Multi-direction and Multi-scale Pyramid in Transformer for Video-based Pedestrian Retrieval 12 Feb 2022 · 1 repository · arXiv:2202.06014
-
Multi-direction and Multi-scale Pyramid in Transformer for Video-based Pedestrian Retrieval 12 Feb 2022 · 1 repository
-
Including Facial Expressions in Contextual Embeddings for Sign Language Generation 11 Feb 2022 · 0 repositories · arXiv:2202.05383
-
AA-TransUNet: Attention Augmented TransUNet For Nowcasting Tasks 10 Feb 2022 · 1 repository · arXiv:2202.04996
-
The Volcspeech system for the ICASSP 2022 multi-channel multi-party meeting transcription challenge 9 Feb 2022 · 0 repositories · arXiv:2202.04261
-
CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations 8 Feb 2022 · 0 repositories · arXiv:2202.03587
-
Efficacy of Transformer Networks for Classification of Raw EEG Data 8 Feb 2022 · 0 repositories · arXiv:2202.05170
-
Particle Transformer for Jet Tagging 8 Feb 2022 · 1 repository · arXiv:2202.03772Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language 7 Feb 2022 · 12 repositories · arXiv:2202.03555Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Efficient Adapter Transfer of Self-Supervised Speech Models for Automatic Speech Recognition 7 Feb 2022 · 1 repository · arXiv:2202.03218Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
-
Recent Trends in 2D Object Detection and Applications in Video Event Recognition 7 Feb 2022 · 0 repositories · arXiv:2202.03206
-
Structure-Aware Transformer for Graph Representation Learning 7 Feb 2022 · 3 repositories · arXiv:2202.03036Syntology official (archive's flag): 2 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
User Satisfaction Estimation with Sequential Dialogue Act Modeling in Goal-oriented Conversational Systems 7 Feb 2022 · 1 repository · arXiv:2202.02912
-
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models 6 Feb 2022 · 1 repository · arXiv:2202.02664Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Pre-Trained Neural Language Models for Automatic Mobile App User Feedback Answer Generation 4 Feb 2022 · 0 repositories · arXiv:2202.02294
-
Supervised Contrastive Learning for Product Matching 4 Feb 2022 · 1 repository · arXiv:2202.02098
-
TransFollower: Long-Sequence Car-Following Trajectory Prediction through Transformer 4 Feb 2022 · 0 repositories · arXiv:2202.03183
-
Brain Cancer Survival Prediction on Treatment-na ive MRI using Deep Anchor Attention Learning with Vision Transformer 3 Feb 2022 · 0 repositories · arXiv:2202.01857
-
ETSformer: Exponential Smoothing Transformers for Time-series Forecasting 3 Feb 2022 · 3 repositories · arXiv:2202.01381Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 2 pointer-only (licence)
-
Exploring Transformer Backbones for Heterogeneous Treatment Effect Estimation 2 Feb 2022 · 1 repository · arXiv:2202.01336Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
AlphaDesign: A graph protein design method and benchmark on AlphaFoldDB 1 Feb 2022 · 1 repository · arXiv:2202.01079
-
LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Data 1 Feb 2022 · 1 repository · arXiv:2202.00185Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples)
-
Is the Performance of My Deep Network Too Good to Be True? A Direct Approach to Estimating the Bayes Error in Binary Classification 1 Feb 2022 · 1 repository · arXiv:2202.00395Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Local Feature Matching with Transformers for low-end devices 1 Feb 2022 · 1 repository · arXiv:2202.00770
-
Regression Transformer: Concurrent sequence regression and generation for molecular language modeling 1 Feb 2022 · 1 repository · arXiv:2202.01338Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
-
Transformer-based Models of Text Normalization for Speech Applications 1 Feb 2022 · 0 repositories · arXiv:2202.00153
-
BOAT: Bilateral Local Attention Vision Transformer 31 Jan 2022 · 1 repository · arXiv:2201.13027
-
Fast Monte-Carlo Approximation of the Attention Mechanism 30 Jan 2022 · 0 repositories · arXiv:2201.12854
-
FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting 30 Jan 2022 · 3 repositories · arXiv:2201.12740Syntology community repositories only · 14 ran (of which 8 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples)
-
GRPE: Relative Positional Encoding for Graph Transformer 30 Jan 2022 · 1 repository · arXiv:2201.12787Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting 30 Jan 2022 · 4 repositories · arXiv:2201.12886Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
TransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images 30 Jan 2022 · 2 repositories · arXiv:2201.12785
-
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models 29 Jan 2022 · 0 repositories · arXiv:2201.12507
-
Decepticons: Corrupted Transformers Breach Privacy in Federated Learning for Language Models 29 Jan 2022 · 1 repository · arXiv:2201.12675
-
Research on Patch Attentive Neural Process 29 Jan 2022 · 0 repositories · arXiv:2202.01884
-
Rewiring with Positional Encodings for Graph Neural Networks 29 Jan 2022 · 0 repositories · arXiv:2201.12674
-
Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptions 28 Jan 2022 · 6 repositories · arXiv:2201.12296Syntology official (archive's flag): 11 ran · 24 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 2 honoured, 0 violated, 14 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified (of 29 harvested samples) · 7 pointer-only (licence)
-
Can Wikipedia Help Offline Reinforcement Learning? 28 Jan 2022 · 1 repository · arXiv:2201.12122Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR 28 Jan 2022 · 8 repositories · arXiv:2201.12329Syntology community repositories only · 6 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
O-ViT: Orthogonal Vision Transformer 28 Jan 2022 · 0 repositories · arXiv:2201.12133
-
VRT: A Video Restoration Transformer 28 Jan 2022 · 1 repository · arXiv:2201.12288Syntology official (archive's flag): 3 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Generalised Image Outpainting with U-Transformer 27 Jan 2022 · 1 repository · arXiv:2201.11403
-
Transformer Module Networks for Systematic Generalization in Visual Question Answering 27 Jan 2022 · 1 repository · arXiv:2201.11316
-
DNNFuser: Generative Pre-Trained Transformer as a Generalized Mapper for Layer Fusion in DNN Accelerators 26 Jan 2022 · 0 repositories · arXiv:2201.11218
-
On the Effectiveness of Pinyin-Character Dual-Decoding for End-to-End Mandarin Chinese ASR 26 Jan 2022 · 0 repositories · arXiv:2201.10792
-
Dual-Tasks Siamese Transformer Framework for Building Damage Assessment 26 Jan 2022 · 0 repositories · arXiv:2201.10953
-
Neural Grapheme-to-Phoneme Conversion with Pre-trained Grapheme Models 26 Jan 2022 · 1 repository · arXiv:2201.10716
-
Predicting Knee Osteoarthritis Progression from Structural MRI using Deep Learning 26 Jan 2022 · 1 repository · arXiv:2201.10849
-
TransPPG: Two-stream Transformer for Remote Heart Rate Estimate 26 Jan 2022 · 0 repositories · arXiv:2201.10873