Methods › General › Position Embeddings › Absolute Position Encodings › Papers, page 117
Absolute Position Encodings
Papers archive 2025-07-28
archive papers tagged: 13,942 · with a code link: 6,505 · where Syntology ran a sample: 2,224 (1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,224 of 13,942 tagged: 1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 117 of 140: papers 11,601 to 11,700 of 13,942, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation 13 Sep 2021 · 1 repository · arXiv:2109.05729
-
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation 13 Sep 2021 · 0 repositories · arXiv:2109.06243
-
On Pursuit of Designing Multi-modal Transformer for Video Grounding 13 Sep 2021 · 0 repositories · arXiv:2109.06085
-
Packed Levitated Marker for Entity and Relation Extraction 13 Sep 2021 · 2 repositories · arXiv:2109.06067Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis 12 Sep 2021 · 2 repositories · arXiv:2109.05488
-
Constructing Phrase-level Semantic Labels to Form Multi-Grained Supervision for Image-Text Retrieval 12 Sep 2021 · 0 repositories · arXiv:2109.05523
-
Levenshtein Training for Word-level Quality Estimation 12 Sep 2021 · 1 repository · arXiv:2109.05611
-
Single-Read Reconstruction for DNA Data Storage Using Transformers 12 Sep 2021 · 0 repositories · arXiv:2109.05478
-
Sparse MLP for Image Recognition: Is Self-Attention Really Necessary? 12 Sep 2021 · 2 repositories · arXiv:2109.05422
-
TEASEL: A Transformer-Based Speech-Prefixed Language Model 12 Sep 2021 · 1 repository · arXiv:2109.05522Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
Bornon: Bengali Image Captioning with Transformer-based Deep learning approach 11 Sep 2021 · 0 repositories · arXiv:2109.05218
-
Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systems 11 Sep 2021 · 1 repository · arXiv:2109.05217
-
Multilingual Translation via Grafting Pre-trained Language Models 11 Sep 2021 · 1 repository · arXiv:2109.05256
-
Real-time multimodal image registration with partial intraoperative point-set data 10 Sep 2021 · 0 repositories · arXiv:2109.05023
-
Temporal Pyramid Transformer with Multimodal Interaction for Video Question Answering 10 Sep 2021 · 1 repository · arXiv:2109.04735
-
A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generation 9 Sep 2021 · 1 repository · arXiv:2109.04096Syntology official (archive's flag): 18 ran · 18 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 1 violated, 11 with no contract checked; 6 where Syntology's instrument failed) · 9 unverified (of 27 harvested samples) · 5 pointer-only (licence)
-
Bag of Tricks for Optimizing Transformer Efficiency 9 Sep 2021 · 1 repository · arXiv:2109.04030
-
DAN: Decentralized Attention-based Neural Network for the MinMax Multiple Traveling Salesman Problem 9 Sep 2021 · 0 repositories · arXiv:2109.04205
-
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding 9 Sep 2021 · 2 repositories · arXiv:2109.04380
-
Graph-Based Decoding for Task Oriented Semantic Parsing 9 Sep 2021 · 0 repositories · arXiv:2109.04587
-
MATE: Multi-view Attention for Table Transformer Efficiency 9 Sep 2021 · 1 repository · arXiv:2109.04312
-
Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systems 9 Sep 2021 · 1 repository · arXiv:2109.04084Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer 9 Sep 2021 · 3 repositories · arXiv:2109.04335Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems 9 Sep 2021 · 2 repositories · arXiv:2109.04314
-
Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction 8 Sep 2021 · 1 repository · arXiv:2109.03659
-
Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformers 8 Sep 2021 · 3 repositories · arXiv:2109.03814
-
Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models 8 Sep 2021 · 0 repositories · arXiv:2109.03892
-
What's Hidden in a One-layer Randomly Weighted Transformer? 8 Sep 2021 · 1 repository · arXiv:2109.03939
-
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting 7 Sep 2021 · 1 repository · arXiv:2109.02974Syntology official (archive's flag): 10 ran · 10 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Hierarchical Graph Convolutional Skeleton Transformer for Action Recognition 7 Sep 2021 · 0 repositories · arXiv:2109.02860
-
Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval 7 Sep 2021 · 0 repositories · arXiv:2109.02789
-
nnFormer: Interleaved Transformer for Volumetric Segmentation 7 Sep 2021 · 2 repositories · arXiv:2109.03201Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Puzzle Solving without Search or Human Knowledge: An Unnatural Language Approach 7 Sep 2021 · 0 repositories · arXiv:2109.02797
-
Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos 7 Sep 2021 · 8 repositories · arXiv:2109.03223
-
3D Human Texture Estimation from a Single Image with Transformers 6 Sep 2021 · 1 repository · arXiv:2109.02563Syntology official (archive's flag): 14 ran · 14 ran (of which 7 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Eliminating Sentiment Bias for Aspect-Level Sentiment Classification with Unsupervised Opinion Extraction 6 Sep 2021 · 1 repository · arXiv:2109.02403
-
Enhancing Natural Language Representation with Large-Scale Out-of-Domain Commonsense 6 Sep 2021 · 1 repository · arXiv:2109.02572
-
PermuteFormer: Efficient Relative Position Encoding for Long Sequences 6 Sep 2021 · 1 repository · arXiv:2109.02377Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
The Animation Transformer: Visual Correspondence via Segment Matching 6 Sep 2021 · 0 repositories · arXiv:2109.02614
-
Vision Transformers For Weeds and Crops Classification Of High Resolution UAV Images 6 Sep 2021 · 0 repositories · arXiv:2109.02716
-
Voxel Transformer for 3D Object Detection 6 Sep 2021 · 1 repository · arXiv:2109.02497Syntology 0 ran · 7 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Transformer Models for Text Coherence Assessment 5 Sep 2021 · 2 repositories · arXiv:2109.02176
-
Error Detection in Large-Scale Natural Language Understanding Systems Using Transformer Models 4 Sep 2021 · 0 repositories · arXiv:2109.01754
-
Contextualized Embeddings based Convolutional Neural Networks for Duplicate Question Identification 3 Sep 2021 · 0 repositories · arXiv:2109.01560
-
IMG2SMI: Translating Molecular Structure Images to Simplified Molecular-input Line-entry System 3 Sep 2021 · 0 repositories · arXiv:2109.04202
-
Semantic Segmentation on VSPW Dataset through Aggregation of Transformer Models 3 Sep 2021 · 0 repositories · arXiv:2109.01316
-
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation 2 Sep 2021 · 5 repositories · arXiv:2109.00859Syntology official: harvested, nothing ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstruction 1 Sep 2021 · 1 repository · arXiv:2109.00512
-
CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations 1 Sep 2021 · 1 repository · arXiv:2109.00181Syntology official (archive's flag): 13 ran · 15 ran (of which 2 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 19 harvested samples) · 6 pointer-only (licence)
-
∞-former: Infinite Memory Transformer 1 Sep 2021 · 1 repository · arXiv:2109.00301
-
Searching for Efficient Multi-Stage Vision Transformers 1 Sep 2021 · 1 repository · arXiv:2109.00642
-
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translation 1 Sep 2021 · 1 repository · arXiv:2109.13318Syntology official (archive's flag): 5 ran · 5 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
AraT5: Text-to-Text Transformers for Arabic Language Generation 31 Aug 2021 · 1 repository · arXiv:2109.12068
-
SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models 31 Aug 2021 · 0 repositories · arXiv:2108.13672
-
A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP 30 Aug 2021 · 1 repository · arXiv:2108.13002
-
From General to Specific: Informative Scene Graph Generation via Balance Adjustment 30 Aug 2021 · 1 repository · arXiv:2108.13129Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Multi-Channel Transformer Transducer for Speech Recognition 30 Aug 2021 · 0 repositories · arXiv:2108.12953
-
Scheduled Sampling Based on Decoding Steps for Neural Machine Translation 30 Aug 2021 · 1 repository · arXiv:2108.12963
-
Shatter: An Efficient Transformer Encoder with Single-Headed Self-Attention and Relative Sequence Partitioning 30 Aug 2021 · 0 repositories · arXiv:2108.13032
-
TCCT: Tightly-Coupled Convolutional Transformer on Time Series Forecasting 29 Aug 2021 · 2 repositories · arXiv:2108.12784
-
AMMASurv: Asymmetrical Multi-Modal Attention for Accurate Survival Analysis with Whole Slide Images and Gene Expression Data 28 Aug 2021 · 0 repositories · arXiv:2108.12565
-
GroupFormer: Group Activity Recognition with Clustered Spatial-Temporal Transformer 28 Aug 2021 · 1 repository · arXiv:2108.12630Syntology official (archive's flag): 20 ran · 22 ran (of which 2 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 14 where Syntology's instrument failed) · 5 unverified (of 27 harvested samples) · 2 pointer-only (licence)
-
Towards Fine-grained Image Classification with Generative Adversarial Networks and Facial Landmark Detection 28 Aug 2021 · 1 repository · arXiv:2109.00891
-
Lyra: A Benchmark for Turducken-Style Code Generation 27 Aug 2021 · 1 repository · arXiv:2108.12144
-
Can the Transformer Be Used as a Drop-in Replacement for RNNs in Text-Generating GANs? 26 Aug 2021 · 0 repositories · arXiv:2108.12275
-
Evaluating Transformer-based Semantic Segmentation Networks for Pathological Image Segmentation 26 Aug 2021 · 0 repositories · arXiv:2108.11993
-
DeepGene Transformer: Transformer for the gene expression-based classification of cancer subtypes 26 Aug 2021 · 0 repositories · arXiv:2108.11833
-
Reiterative Domain Aware Multi-Target Adaptation 26 Aug 2021 · 0 repositories · arXiv:2109.00919
-
Shifted Chunk Transformer for Spatio-Temporal Representational Learning 26 Aug 2021 · 0 repositories · arXiv:2108.11575
-
The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers 26 Aug 2021 · 2 repositories · arXiv:2108.12284Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios 26 Aug 2021 · 3 repositories · arXiv:2108.11539
-
CancerBERT: a BERT model for Extracting Breast Cancer Phenotypes from Electronic Health Records 25 Aug 2021 · 0 repositories · arXiv:2108.11303
-
Transformer for Single Image Super-Resolution 25 Aug 2021 · 1 repository · arXiv:2108.11084Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 4 pointer-only (licence)
-
Auto-Parsing Network for Image Captioning and Visual Question Answering 24 Aug 2021 · 0 repositories · arXiv:2108.10568
-
Greenformers: Improving Computation and Memory Efficiency in Transformer Models via Low-Rank Approximation 24 Aug 2021 · 0 repositories · arXiv:2108.10808
-
Using BERT Encoding and Sentence-Level Language Model for Sentence Ordering 24 Aug 2021 · 0 repositories · arXiv:2108.10986
-
Improving 3D Object Detection with Channel-wise Transformer 23 Aug 2021 · 1 repository · arXiv:2108.10723Syntology official (archive's flag): 6 ran · 6 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples)
-
Recurrent multiple shared layers in Depth for Neural Machine Translation 23 Aug 2021 · 0 repositories · arXiv:2108.10417
-
SwinIR: Image Restoration Using Swin Transformer 23 Aug 2021 · 9 repositories · arXiv:2108.10257Syntology official (archive's flag): 3 ran · 30 ran (of which 14 constructed an object rather than computing a result; 16 with no instrument failure: 0 honoured, 0 violated, 16 with no contract checked; 14 where Syntology's instrument failed) · 15 unverified (of 45 harvested samples) · 5 pointer-only (licence)
-
ZS-SLR: Zero-Shot Sign Language Recognition from RGB-D Videos 23 Aug 2021 · 0 repositories · arXiv:2108.10059
-
Guiding Query Position and Performing Similar Attention for Transformer-Based Detection Heads 22 Aug 2021 · 0 repositories · arXiv:2108.09691
-
Spatial Transformer Networks for Curriculum Learning 22 Aug 2021 · 0 repositories · arXiv:2108.09696
-
StarVQA: Space-Time Attention for Video Quality Assessment 22 Aug 2021 · 0 repositories · arXiv:2108.09635
-
UzBERT: pretraining a BERT model for Uzbek 22 Aug 2021 · 0 repositories · arXiv:2108.09814
-
Construction material classification on imbalanced datasets using Vision Transformer (ViT) architecture 21 Aug 2021 · 0 repositories · arXiv:2108.09527
-
Approximate Bayesian Neural Doppler Imaging 20 Aug 2021 · 1 repository · arXiv:2108.09266
-
Convolutional Neural Network (CNN) vs Vision Transformer (ViT) for Digital Holography 20 Aug 2021 · 0 repositories · arXiv:2108.09147
-
Fastformer: Additive Attention Can Be All You Need 20 Aug 2021 · 13 repositories · arXiv:2108.09084Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 3 pointer-only (licence)
-
Frozen Pretrained Transformers for Neural Sign Language Translation 20 Aug 2021 · 1 repository
-
MM-ViT: Multi-Modal Video Transformer for Compressed Video Action Recognition 20 Aug 2021 · 0 repositories · arXiv:2108.09322
-
One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profiles 20 Aug 2021 · 1 repository · arXiv:2108.09355
-
Pre-training for Ad-hoc Retrieval: Hyperlink is Also You Need 20 Aug 2021 · 1 repository · arXiv:2108.09346
-
Semantic Communication with Adaptive Universal Transformer 20 Aug 2021 · 0 repositories · arXiv:2108.09119
-
Smart Bird: Learnable Sparse Attention for Efficient and Effective Transformer 20 Aug 2021 · 0 repositories · arXiv:2108.09193
-
Trans4Trans: Efficient Transformer for Transparent Object and Semantic Scene Segmentation in Real-World Navigation Assistance 20 Aug 2021 · 1 repository · arXiv:2108.09174
-
Causal Attention for Unbiased Visual Recognition 19 Aug 2021 · 1 repository · arXiv:2108.08782Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Contrastive Language-Image Pre-training for the Italian Language 19 Aug 2021 · 1 repository · arXiv:2108.08688
-
Do Vision Transformers See Like Convolutional Neural Networks? 19 Aug 2021 · 4 repositories · arXiv:2108.08810Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation 19 Aug 2021 · 0 repositories · arXiv:2108.08447
-
Video Relation Detection via Tracklet based Visual Transformer 19 Aug 2021 · 1 repository · arXiv:2108.08669