Methods › General › Position Embeddings › Absolute Position Encodings › Papers, page 133
Absolute Position Encodings
Papers archive 2025-07-28
archive papers tagged: 13,942 · with a code link: 6,505 · where Syntology ran a sample: 2,224 (1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,224 of 13,942 tagged: 1,897 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 133 of 140: papers 13,201 to 13,300 of 13,942, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Teaching Temporal Logics to Neural Networks 6 Mar 2020 · 2 repositories · arXiv:2003.04218Syntology official (archive's flag): 5 ran · 14 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 10 unverified (of 24 harvested samples)
-
State-of-the-Art Augmented NLP Transformer models for direct and single-step retrosynthesis 5 Mar 2020 · 1 repository · arXiv:2003.02804
-
EmpTransfo: A Multi-head Transformer Architecture for Creating Empathetic Dialog Systems 5 Mar 2020 · 1 repository · arXiv:2003.02958
-
AlignTTS: Efficient Feed-Forward Text-to-Speech System without Explicit Alignment 4 Mar 2020 · 2 repositories · arXiv:2003.01950Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 3 pointer-only (licence)
-
Data Augmentation using Pre-trained Transformer Models 4 Mar 2020 · 4 repositories · arXiv:2003.02245Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples)
-
Controllable Time-Delay Transformer for Real-Time Punctuation Prediction and Disfluency Detection 3 Mar 2020 · 0 repositories · arXiv:2003.01309
-
Heterogeneous Graph Transformer 3 Mar 2020 · 4 repositories · arXiv:2003.01332Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples) · 3 pointer-only (licence)
-
Meta-Embeddings Based On Self-Attention 3 Mar 2020 · 0 repositories · arXiv:2003.01371
-
Transfer Learning for Context-Aware Spoken Language Understanding 3 Mar 2020 · 0 repositories · arXiv:2003.01305
-
Transformer++ 2 Mar 2020 · 0 repositories · arXiv:2003.04974
-
Automatic Perturbation Analysis for Scalable Certified Robustness and Beyond 28 Feb 2020 · 7 repositories · arXiv:2002.12920Syntology community repositories only · 14 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 2 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples) · 2 pointer-only (licence)
-
Exploring and Distilling Cross-Modal Information for Image Captioning 28 Feb 2020 · 0 repositories · arXiv:2002.12585
-
Compressing Large-Scale Transformer-Based Models: A Case Study on BERT 27 Feb 2020 · 0 repositories · arXiv:2002.11985
-
Marathi To English Neural Machine Translation With Near Perfect Corpus And Transformers 26 Feb 2020 · 1 repository · arXiv:2002.11643
-
Multi-task Learning with Multi-head Attention for Multi-choice Reading Comprehension 26 Feb 2020 · 0 repositories · arXiv:2003.04992
-
Sparse Sinkhorn Attention 26 Feb 2020 · 1 repository · arXiv:2002.11296
-
Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers 26 Feb 2020 · 2 repositories · arXiv:2002.11794
-
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers 25 Feb 2020 · 1 repository · arXiv:2002.10957
-
Exploring BERT Parameter Efficiency on the Stanford Question Answering Dataset v2.0 25 Feb 2020 · 0 repositories · arXiv:2002.10670
-
Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation 24 Feb 2020 · 0 repositories · arXiv:2002.10260
-
GRET: Global Representation Enhanced Transformer 24 Feb 2020 · 0 repositories · arXiv:2002.10101
-
Sketchformer: Transformer-based Representation for Sketched Structure 24 Feb 2020 · 1 repository · arXiv:2002.10381Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Addressing Some Limitations of Transformers with Feedback Memory 21 Feb 2020 · 4 repositories · arXiv:2002.09402Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Learning Dynamic Belief Graphs to Generalize on Text-Based Games 21 Feb 2020 · 1 repository · arXiv:2002.09127
-
Transformer Hawkes Process 21 Feb 2020 · 3 repositories · arXiv:2002.09291Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
LAMBERT: Layout-Aware (Language) Modeling for information extraction 19 Feb 2020 · 1 repository · arXiv:2002.08087
-
Molecule Attention Transformer 19 Feb 2020 · 7 repositories · arXiv:2002.08264Syntology official (archive's flag): 2 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 3 pointer-only (licence)
-
Towards Making the Most of Context in Neural Machine Translation 19 Feb 2020 · 1 repository · arXiv:2002.07982
-
Tree-structured Attention with Hierarchical Accumulation 19 Feb 2020 · 0 repositories · arXiv:2002.08046
-
Conditional Self-Attention for Query-based Summarization 18 Feb 2020 · 0 repositories · arXiv:2002.07338
-
Gradient-Based Adversarial Training on Transformer Networks for Detecting Check-Worthy Factual Claims 18 Feb 2020 · 1 repository · arXiv:2002.07725
-
Hierarchical Transformer Network for Utterance-level Emotion Recognition 18 Feb 2020 · 0 repositories · arXiv:2002.07551
-
Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue 18 Feb 2020 · 3 repositories · arXiv:2002.07510Syntology official: not harvested · 0 ran · 5 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Uncertainty Estimation in Autoregressive Structured Prediction 18 Feb 2020 · 1 repository · arXiv:2002.07650
-
A Financial Service Chatbot based on Deep Bidirectional Transformers 17 Feb 2020 · 0 repositories · arXiv:2003.04987
-
Controlling Computation versus Quality for Neural Sequence Models 17 Feb 2020 · 0 repositories · arXiv:2002.07106
-
Low-Rank Bottleneck in Multi-head Attention Models 17 Feb 2020 · 0 repositories · arXiv:2002.07028
-
Multi-layer Representation Fusion for Neural Machine Translation 16 Feb 2020 · 1 repository · arXiv:2002.06714Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Neural Machine Translation with Joint Representation 16 Feb 2020 · 1 repository · arXiv:2002.06546
-
Small energy masking for improved neural network training for end-to-end speech recognition 15 Feb 2020 · 0 repositories · arXiv:2002.06312
-
UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation 15 Feb 2020 · 2 repositories · arXiv:2002.06353Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Deep Attentive Study Session Dropout Prediction in Mobile Learning Environment 14 Feb 2020 · 0 repositories · arXiv:2002.11624
-
Stress Test Evaluation of Transformer-based Models in Natural Language Understanding Tasks 14 Feb 2020 · 0 repositories · arXiv:2002.06261
-
Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracing 14 Feb 2020 · 5 repositories · arXiv:2002.07033Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Transformer on a Diet 14 Feb 2020 · 1 repository · arXiv:2002.06170
-
Sparse and Structured Visual Attention 13 Feb 2020 · 1 repository · arXiv:2002.05556
-
Attentional Speech Recognition Models Misbehave on Out-of-domain Utterances 12 Feb 2020 · 1 repository · arXiv:2002.05150
-
End-to-End Face Parsing via Interlinked Convolutional Neural Networks 12 Feb 2020 · 1 repository · arXiv:2002.04831
-
GLU Variants Improve Transformer 12 Feb 2020 · 27 repositories · arXiv:2002.05202Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 4 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 7 pointer-only (licence)
-
On Layer Normalization in the Transformer Architecture 12 Feb 2020 · 9 repositories · arXiv:2002.04745Syntology 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
-
Superbloom: Bloom filter meets Transformer 11 Feb 2020 · 0 repositories · arXiv:2002.04723
-
Training with Streaming Annotation 11 Feb 2020 · 0 repositories · arXiv:2002.04165
-
Deep Representation Learning for Dynamical Systems Modeling 10 Feb 2020 · 0 repositories · arXiv:2002.05111
-
End-to-End Multi-speaker Speech Recognition with Transformer 10 Feb 2020 · 0 repositories · arXiv:2002.03921
-
Pre-training Tasks for Embedding-based Large-scale Retrieval 10 Feb 2020 · 0 repositories · arXiv:2002.03932
-
StickyPillars: Robust and Efficient Feature Matching on Point Clouds using Graph Neural Networks 10 Feb 2020 · 0 repositories · arXiv:2002.03983
-
On the distance between two neural networks and the stability of learning 9 Feb 2020 · 2 repositories · arXiv:2002.03432
-
Blank Language Models 8 Feb 2020 · 1 repository · arXiv:2002.03079Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Multimodal Matching Transformer for Live Commenting 7 Feb 2020 · 0 repositories · arXiv:2002.02649
-
Transformer-Capsule Model for Intent Detection 7 Feb 2020 · 0 repositories
-
Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss 7 Feb 2020 · 5 repositories · arXiv:2002.02562Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Few-Shot Learning as Domain Adaptation: Algorithm and Analysis 6 Feb 2020 · 0 repositories · arXiv:2002.02050
-
perm2vec: Graph Permutation Selection for Decoding of Error Correction Codes using Self-Attention 6 Feb 2020 · 0 repositories · arXiv:2002.02315
-
Aligning the Pretraining and Finetuning Objectives of Language Models 5 Feb 2020 · 0 repositories · arXiv:2002.02000
-
Vocoder-free End-to-End Voice Conversion with Transformer Network 5 Feb 2020 · 1 repository · arXiv:2002.03808
-
Interpretable & Time-Budget-Constrained Contextualization for Re-Ranking 4 Feb 2020 · 1 repository · arXiv:2002.01854
-
Learning Long- and Short-Term User Literal-Preference with Multimodal Hierarchical Transformer Network for Personalized Image Caption 4 Feb 2020 · 0 repositories
-
Multistage Model for Robust Face Alignment Using Deep Neural Networks 4 Feb 2020 · 0 repositories · arXiv:2002.01075
-
IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems 3 Feb 2020 · 1 repository · arXiv:2002.00571
-
Bridging Text and Video: A Universal Multimodal Transformer for Video-Audio Scene-Aware Dialog 1 Feb 2020 · 1 repository · arXiv:2002.00163Syntology 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions 1 Feb 2020 · 7 repositories · arXiv:2002.00212
-
Pretrained Transformers for Simple Question Answering over Knowledge Graphs 31 Jan 2020 · 1 repository · arXiv:2001.11985
-
Interpretable Rumor Detection in Microblogs by Attending to User Interactions 29 Jan 2020 · 1 repository · arXiv:2001.10667
-
Applying Recent Innovations from NLP to MOOC Student Course Trajectory Modeling 23 Jan 2020 · 0 repositories · arXiv:2001.08333
-
Multi-level Head-wise Match and Aggregation in Transformer for Textual Sequence Matching 20 Jan 2020 · 0 repositories · arXiv:2001.07234
-
Recommending Themes for Ad Creative Design via Visual-Linguistic Representations 20 Jan 2020 · 1 repository · arXiv:2001.07194
-
A multimodal deep learning approach for named entity recognition from social media 19 Jan 2020 · 0 repositories · arXiv:2001.06888
-
Deep Learning for Hindi Text Classification: A Comparison 19 Jan 2020 · 0 repositories · arXiv:2001.10340
-
Shifted and Squeezed 8-bit Floating Point format for Low-Precision Training of Deep Neural Networks 16 Jan 2020 · 0 repositories · arXiv:2001.05674
-
Insertion-Deletion Transformer 15 Jan 2020 · 0 repositories · arXiv:2001.05540
-
Non-Autoregressive Machine Translation with Disentangled Context Transformer 15 Jan 2020 · 1 repository · arXiv:2001.05136
-
Transformer-based Online CTC/attention End-to-End Speech Recognition Architecture 15 Jan 2020 · 0 repositories · arXiv:2001.08290
-
Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders 14 Jan 2020 · 0 repositories · arXiv:2001.05308
-
The problems with using STNs to align CNN feature maps 14 Jan 2020 · 0 repositories · arXiv:2001.05858
-
Reformer: The Efficient Transformer 13 Jan 2020 · 10 repositories · arXiv:2001.04451Syntology community repositories only · 6 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
Urdu-English Machine Transliteration using Neural Networks 12 Jan 2020 · 0 repositories · arXiv:2001.05296
-
Spatial-Temporal Transformer Networks for Traffic Flow Forecasting 9 Jan 2020 · 1 repository · arXiv:2001.02908
-
Streaming automatic speech recognition with the transformer model 8 Jan 2020 · 0 repositories · arXiv:2001.02674
-
RECAST: Interactive Auditing of Automatic Toxicity Detection Models 7 Jan 2020 · 0 repositories · arXiv:2001.01819
-
FDFtNet: Facing Off Fake Images using Fake Detection Fine-tuning Network 5 Jan 2020 · 2 repositories · arXiv:2001.01265Syntology official (archive's flag): 4 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 13 harvested samples)
-
Learning Accurate Integer Transformer Machine-Translation Models 3 Jan 2020 · 0 repositories · arXiv:2001.00926
-
Two-Level Transformer and Auxiliary Coherence Modeling for Improved Text Segmentation 3 Jan 2020 · 1 repository · arXiv:2001.00891
-
Representing Unordered Data Using Complex-Weighted Multiset Automata 2 Jan 2020 · 0 repositories · arXiv:2001.00610
-
BERT-AL: BERT for Arbitrarily Long Document Understanding 1 Jan 2020 · 0 repositories
-
NEURAL EXECUTION ENGINES 1 Jan 2020 · 0 repositories
-
Poly-encoders: Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring 1 Jan 2020 · 2 repositories
-
Deep Attentive Ranking Networks for Learning to Order Sentences 31 Dec 2019 · 0 repositories · arXiv:2001.00056
-
EEG based Continuous Speech Recognition using Transformers 31 Dec 2019 · 0 repositories · arXiv:2001.00501
-
AraNet: A Deep Learning Toolkit for Arabic Social Media 30 Dec 2019 · 1 repository · arXiv:1912.13072
-
All-in-One Image-Grounded Conversational Agents 28 Dec 2019 · 0 repositories · arXiv:1912.12394