Methods › General › Position Embeddings › Absolute Position Encodings › Papers, page 124
Absolute Position Encodings
Papers archive 2025-07-28
archive papers tagged: 13,942 · with a code link: 6,505 · where Syntology ran a sample: 2,224 (1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,224 of 13,942 tagged: 1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 124 of 140: papers 12,301 to 12,400 of 13,942, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformer 12 Mar 2021 · 0 repositories · arXiv:2103.07062
-
Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus 12 Mar 2021 · 0 repositories · arXiv:2103.07055
-
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation 11 Mar 2021 · 6 repositories · arXiv:2103.06874
-
Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks 11 Mar 2021 · 0 repositories · arXiv:2103.06982
-
On Improving Deep Learning Trace Analysis with System Call Arguments 11 Mar 2021 · 0 repositories · arXiv:2103.06915
-
Unknown Object Segmentation from Stereo Images 11 Mar 2021 · 2 repositories · arXiv:2103.06796
-
CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review 10 Mar 2021 · 2 repositories · arXiv:2103.06268
-
Pretrained Transformers as Universal Computation Engines 9 Mar 2021 · 4 repositories · arXiv:2103.05247
-
End-to-End Human Object Interaction Detection with HOI Transformer 8 Mar 2021 · 1 repository · arXiv:2103.04503Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
MTLHealth: A Deep Learning System for Detecting Disturbing Content in Student Essays 7 Mar 2021 · 0 repositories · arXiv:2103.04290
-
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees 7 Mar 2021 · 1 repository · arXiv:2103.04350
-
TransBTS: Multimodal Brain Tumor Segmentation Using Transformer 7 Mar 2021 · 3 repositories · arXiv:2103.04430
-
Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth 5 Mar 2021 · 1 repository · arXiv:2103.03404
-
Hierarchical Transformer for Multilingual Machine Translation 5 Mar 2021 · 0 repositories · arXiv:2103.03589
-
IOT: Instance-wise Layer Reordering for Transformer Structures 5 Mar 2021 · 1 repository · arXiv:2103.03457Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 5 harvested samples) · 5 pointer-only (licence)
-
Measuring Mathematical Problem Solving With the MATH Dataset 5 Mar 2021 · 5 repositories · arXiv:2103.03874Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
SpecTr: Spectral Transformer for Hyperspectral Pathology Image Segmentation 5 Mar 2021 · 1 repository · arXiv:2103.03604
-
CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation 4 Mar 2021 · 1 repository · arXiv:2103.03024
-
End-to-end acoustic modelling for phone recognition of young readers 4 Mar 2021 · 0 repositories · arXiv:2103.02899
-
The Transformer Network for the Traveling Salesman Problem 4 Mar 2021 · 1 repository · arXiv:2103.03012
-
University of Copenhagen Participation in TREC Health Misinformation Track 2020 3 Mar 2021 · 0 repositories · arXiv:2103.02462
-
A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics 2 Mar 2021 · 0 repositories · arXiv:2103.01403
-
Dual Reinforcement-Based Specification Generation for Image De-Rendering 2 Mar 2021 · 0 repositories · arXiv:2103.01867
-
Probing Product Description Generation via Posterior Distillation 2 Mar 2021 · 0 repositories · arXiv:2103.01594
-
CrossMap Transformer: A Crossmodal Masked Path Transformer Using Double Back-Translation for Vision-and-Language Navigation 1 Mar 2021 · 0 repositories · arXiv:2103.00852
-
Generative Chemical Transformer: Neural Machine Learning of Molecular Geometric Structures from Chemical Language via Attention 27 Feb 2021 · 2 repositories · arXiv:2103.00213
-
Transformer in Transformer 27 Feb 2021 · 12 repositories · arXiv:2103.00112Syntology official (archive's flag): 4 ran · 16 ran (of which 12 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 1 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified (of 24 harvested samples) · 5 pointer-only (licence)
-
Transformers with Competitive Ensembles of Independent Mechanisms 27 Feb 2021 · 0 repositories · arXiv:2103.00336
-
LazyFormer: Self Attention with Lazy Update 25 Feb 2021 · 0 repositories · arXiv:2102.12702
-
LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matching 25 Feb 2021 · 1 repository · arXiv:2102.12671
-
MixSpeech: Data Augmentation for Low-resource Automatic Speech Recognition 25 Feb 2021 · 0 repositories · arXiv:2102.12664
-
From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection 24 Feb 2021 · 0 repositories · arXiv:2102.12162
-
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions 24 Feb 2021 · 11 repositories · arXiv:2102.12122Syntology official (archive's flag): 4 ran · 22 ran (of which 16 constructed an object rather than computing a result; 18 with no instrument failure: 2 honoured, 0 violated, 16 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 30 harvested samples) · 1 pointer-only (licence)
-
When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute 24 Feb 2021 · 1 repository · arXiv:2102.12459
-
Accurate Learning of Graph Representations with Graph Multiset Pooling 23 Feb 2021 · 1 repository · arXiv:2102.11533Syntology official (archive's flag): 4 ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 5 harvested samples) · 5 pointer-only (licence)
-
Deep Deformation Detail Synthesis for Thin Shell Models 23 Feb 2021 · 0 repositories · arXiv:2102.11541
-
Do Transformer Modifications Transfer Across Implementations and Applications? 23 Feb 2021 · 1 repository · arXiv:2102.11972
-
Deepfake Video Detection Using Convolutional Vision Transformer 22 Feb 2021 · 1 repository · arXiv:2102.11126
-
Determination of Fault Location in Transmission Lines with Image Processing and Artificial Neural Networks 22 Feb 2021 · 0 repositories · arXiv:2102.11073
-
Conditional Positional Encodings for Vision Transformers 22 Feb 2021 · 2 repositories · arXiv:2102.10882
-
Position Information in Transformers: An Overview 22 Feb 2021 · 0 repositories · arXiv:2102.11090
-
UniT: Multimodal Multitask Learning with a Unified Transformer 22 Feb 2021 · 1 repository · arXiv:2102.10772
-
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation 21 Feb 2021 · 2 repositories · arXiv:2102.10662
-
Multilingual Answer Sentence Reranking via Automatically Translated Data 20 Feb 2021 · 0 repositories · arXiv:2102.10250
-
Towards Accurate and Compact Architectures via Neural Architecture Transformer 20 Feb 2021 · 2 repositories · arXiv:2102.10301
-
Dialect Identification in Nuanced Arabic Tweets Using Farasa Segmentation and AraBERT 19 Feb 2021 · 0 repositories · arXiv:2102.09749
-
Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Prediction 19 Feb 2021 · 2 repositories · arXiv:2104.00563Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 17 harvested samples) · 2 pointer-only (licence)
-
Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer 18 Feb 2021 · 1 repository · arXiv:2102.09550
-
Quiz-Style Question Generation for News Stories 18 Feb 2021 · 2 repositories · arXiv:2102.09094
-
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameters 17 Feb 2021 · 3 repositories · arXiv:2102.08597Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training 16 Feb 2021 · 2 repositories · arXiv:2102.08098Syntology official (archive's flag): 6 ran · 7 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples) · 12 pointer-only (licence)
-
Revisiting Language Encoding in Learning Multilingual Representations 16 Feb 2021 · 1 repository · arXiv:2102.08357
-
Translational Equivariance in Kernelizable Attention 15 Feb 2021 · 1 repository · arXiv:2102.07680
-
Dancing along Battery: Enabling Transformer with Run-time Reconfigurability on Mobile Devices 12 Feb 2021 · 0 repositories · arXiv:2102.06336
-
Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders 12 Feb 2021 · 0 repositories · arXiv:2102.06578
-
Optimizing Inference Performance of Transformers on CPUs 12 Feb 2021 · 0 repositories · arXiv:2102.06621
-
Transformer Language Models with LSTM-based Cross-utterance Information Representation 12 Feb 2021 · 1 repository · arXiv:2102.06474
-
Proof Artifact Co-training for Theorem Proving with Language Models 11 Feb 2021 · 4 repositories · arXiv:2102.06203Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Text Compression-aided Transformer Encoding 11 Feb 2021 · 0 repositories · arXiv:2102.05951
-
NAST: Non-Autoregressive Spatial-Temporal Transformer for Time Series Forecasting 10 Feb 2021 · 1 repository · arXiv:2102.05624
-
Bayesian Transformer Language Models for Speech Recognition 9 Feb 2021 · 0 repositories · arXiv:2102.04754
-
Conversational Query Rewriting with Self-supervised Learning 9 Feb 2021 · 0 repositories · arXiv:2102.04708
-
Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks 9 Feb 2021 · 0 repositories · arXiv:2102.04610
-
Point Cloud Transformers applied to Collider Physics 9 Feb 2021 · 1 repository · arXiv:2102.05073
-
Colorization Transformer 8 Feb 2021 · 2 repositories · arXiv:2102.04432
-
TransReID: Transformer-based Object Re-Identification 8 Feb 2021 · 4 repositories · arXiv:2102.04378
-
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation 8 Feb 2021 · 22 repositories · arXiv:2102.04306Syntology official: no sample here; runs from other or unrecorded repositories · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Wake Word Detection with Streaming Transformers 8 Feb 2021 · 0 repositories · arXiv:2102.04488
-
Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention 7 Feb 2021 · 10 repositories · arXiv:2102.03902Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
baller2vec: A Multi-Entity Transformer For Multi-Agent Spatiotemporal Modeling 5 Feb 2021 · 1 repository · arXiv:2102.03291Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
PipeTransformer: Automated Elastic Pipelining for Distributed Training of Transformers 5 Feb 2021 · 1 repository · arXiv:2102.03161Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision 5 Feb 2021 · 6 repositories · arXiv:2102.03334Syntology official: harvested, nothing ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result (of 4 harvested samples) · 1 pointer-only (licence)
-
MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records 3 Feb 2021 · 0 repositories · arXiv:2102.02340
-
Introduction to Neural Transfer Learning with Transformers for Social Science Text Analysis 3 Feb 2021 · 0 repositories · arXiv:2102.02111
-
Mind the Gap: Assessing Temporal Generalization in Neural Language Models 3 Feb 2021 · 1 repository · arXiv:2102.01951
-
Relaxed Transformer Decoders for Direct Action Proposal Generation 3 Feb 2021 · 2 repositories · arXiv:2102.01894Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Towards Natural and Controllable Cross-Lingual Voice Conversion Based on Neural TTS Model and Phonetic Posteriorgram 3 Feb 2021 · 0 repositories · arXiv:2102.01991
-
Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow 1 Feb 2021 · 1 repository · arXiv:2102.00826
-
GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfer 1 Feb 2021 · 0 repositories · arXiv:2102.00769
-
A Runtime-Based Computational Performance Predictor for Deep Neural Network Training 31 Jan 2021 · 1 repository · arXiv:2102.00527
-
Short Text Clustering with Transformers 31 Jan 2021 · 0 repositories · arXiv:2102.00541
-
Enhancing the Transformer Decoder with Transition-based Syntax 29 Jan 2021 · 1 repository · arXiv:2101.12640
-
LSTM-SAKT: LSTM-Encoded SAKT-like Transformer for Knowledge Tracing 28 Jan 2021 · 0 repositories · arXiv:2102.00845
-
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet 28 Jan 2021 · 13 repositories · arXiv:2101.11986Syntology official (archive's flag): 4 ran · 21 ran (of which 16 constructed an object rather than computing a result; 21 with no instrument failure: 1 honoured, 0 violated, 20 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 26 harvested samples) · 8 pointer-only (licence)
-
An explainable Transformer-based deep learning model for the prediction of incident heart failure 27 Jan 2021 · 0 repositories · arXiv:2101.11359
-
Exploring multi-task multi-lingual learning of transformer models for hate speech and offensive speech identification in social media 27 Jan 2021 · 1 repository · arXiv:2101.11155
-
Spatial-Channel Transformer Network for Trajectory Prediction on the Traffic Scenes 27 Jan 2021 · 0 repositories · arXiv:2101.11472
-
Attention Can Reflect Syntactic Structure (If You Let It) 26 Jan 2021 · 0 repositories · arXiv:2101.10927
-
CPTR: Full Transformer Network for Image Captioning 26 Jan 2021 · 0 repositories · arXiv:2101.10804
-
Randomized Deep Structured Prediction for Discourse-Level Processing 25 Jan 2021 · 0 repositories · arXiv:2101.10435
-
Multi-Task Time Series Forecasting With Shared Attention 24 Jan 2021 · 0 repositories · arXiv:2101.09645
-
Towards a Better Integration of Fuzzy Matches in Neural Machine Translation through Data Augmentation 24 Jan 2021 · 1 repository
-
Enriching Non-Autoregressive Transformer with Syntactic and SemanticStructures for Neural Machine Translation 22 Jan 2021 · 0 repositories · arXiv:2101.08942
-
Activity Graph Transformer for Temporal Action Localization 21 Jan 2021 · 0 repositories · arXiv:2101.08540
-
DAF:re: A Challenging, Crowd-Sourced, Large-Scale, Long-Tailed Dataset For Anime Character Recognition 21 Jan 2021 · 2 repositories · arXiv:2101.08674Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval 21 Jan 2021 · 1 repository · arXiv:2101.08370Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++ 21 Jan 2021 · 1 repository · arXiv:2101.08779
-
Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates 20 Jan 2021 · 0 repositories · arXiv:2101.08133
-
Open-Domain Conversational Search Assistant with Transformers 20 Jan 2021 · 1 repository · arXiv:2101.08197
-
PGT: Pseudo Relevance Feedback Using a Graph-Based Transformer 20 Jan 2021 · 1 repository · arXiv:2101.07918