Methods › General › Attention Mechanisms › Attention › Papers, page 272
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 272 of 316: papers 27,101 to 27,200 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
DReCa: A General Task Augmentation Strategy for Few-Shot Natural Language Inference 1 Jun 2021 · 0 repositories
-
Dual-Objective Fine-Tuning of BERT for Entity Matching 1 Jun 2021 · 1 repository
-
Efficiently Summarizing Text and Graph Encodings of Multi-Document Clusters 1 Jun 2021 · 1 repository
-
Emotion-Infused Models for Explainable Psychological Stress Detection 1 Jun 2021 · 1 repository
-
Iterative Hierarchical Attention for Answering Complex Questions over Long Documents 1 Jun 2021 · 0 repositories · arXiv:2106.00200
-
GPT Perdetry Test: Generating new meanings for new words 1 Jun 2021 · 0 repositories
-
Hie-BART: Document Summarization with Hierarchical BART 1 Jun 2021 · 0 repositories
-
HONEST: Measuring Hurtful Sentence Completion in Language Models 1 Jun 2021 · 1 repository
-
iCompass at NLP4IF-2021–Fighting the COVID-19 Infodemic 1 Jun 2021 · 1 repository
-
Implicit Representations of Meaning in Neural Language Models 1 Jun 2021 · 1 repository · arXiv:2106.00737
-
Improving Automatic Hate Speech Detection with Multiword Expression Features 1 Jun 2021 · 0 repositories · arXiv:2106.00237
-
Multi-Grained Knowledge Distillation for Named Entity Recognition 1 Jun 2021 · 0 repositories
-
Multi-Hop Transformer for Document-Level Machine Translation 1 Jun 2021 · 0 repositories
-
Negation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish. 1 Jun 2021 · 0 repositories
-
On using distributed representations of source code for the detection of C security vulnerabilities 1 Jun 2021 · 1 repository · arXiv:2106.01367
-
Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Information 1 Jun 2021 · 0 repositories · arXiv:2106.00559
-
QuadrupletBERT: An Efficient Model For Embedding-Based Large-Scale Retrieval 1 Jun 2021 · 0 repositories
-
SCRIPT: Self-Critic PreTraining of Transformers 1 Jun 2021 · 0 repositories
-
Shuffled-token Detection for Refining Pre-trained RoBERTa 1 Jun 2021 · 0 repositories
-
Supervised Neural Clustering via Latent Structured Output Learning: Application to Question Intents 1 Jun 2021 · 1 repository
-
THG: Transformer with Hyperbolic Geometry 1 Jun 2021 · 0 repositories · arXiv:2106.07350
-
Too Much in Common: Shifting of Embeddings in Transformer Language Models and its Implications 1 Jun 2021 · 1 repository
-
Towards a Comprehensive Understanding and Accurate Evaluation of Societal Biases in Pre-Trained Transformers 1 Jun 2021 · 0 repositories
-
Towards Modeling the Style of Translators in Neural Machine Translation 1 Jun 2021 · 0 repositories
-
Training Language Models under Resource Constraints for Adversarial Advertisement Detection 1 Jun 2021 · 0 repositories
-
TransVOS: Video Object Segmentation with Transformers 1 Jun 2021 · 1 repository · arXiv:2106.00588
-
Using Integrated Gradients and Constituency Parse Trees to explain Linguistic Acceptability learnt by BERT 1 Jun 2021 · 0 repositories · arXiv:2106.07349
-
WikiTalkEdit: A Dataset for modeling Editors' behaviors on Wikipedia 1 Jun 2021 · 0 repositories
-
You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection 1 Jun 2021 · 2 repositories · arXiv:2106.00666Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples) · 5 pointer-only (licence)
-
Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model 31 May 2021 · 1 repository · arXiv:2105.15089
-
Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation 31 May 2021 · 2 repositories · arXiv:2105.15087
-
Cascaded Head-colliding Attention 31 May 2021 · 1 repository · arXiv:2105.14850Syntology official (archive's flag): 3 ran · 9 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 5 pointer-only (licence)
-
Choose a Transformer: Fourier or Galerkin 31 May 2021 · 1 repository · arXiv:2105.14995Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
M6-T: Exploring Sparse Expert Models and Beyond 31 May 2021 · 0 repositories · arXiv:2105.15082
-
G-Transformer for Document-level Machine Translation 31 May 2021 · 1 repository · arXiv:2105.14761Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
How transfer learning impacts linguistic knowledge in deep NLP models? 31 May 2021 · 0 repositories · arXiv:2105.15179
-
Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognition 31 May 2021 · 2 repositories · arXiv:2105.15075Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers 31 May 2021 · 28 repositories · arXiv:2105.15203Syntology official: no sample here; runs from other or unrecorded repositories · 66 ran (of which 22 constructed an object rather than computing a result; 62 with no instrument failure: 0 honoured, 1 violated, 61 with no contract checked; 4 where Syntology's instrument failed) · 20 unverified (of 86 harvested samples) · 20 pointer-only (licence)
-
Training ELECTRA Augmented with Multi-word Selection 31 May 2021 · 0 repositories · arXiv:2106.00139
-
Zero-shot Fact Verification by Claim Generation 31 May 2021 · 1 repository · arXiv:2105.14682Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
A Compression-Compilation Framework for On-mobile Real-time BERT Applications 30 May 2021 · 0 repositories · arXiv:2106.00526
-
Gaze Estimation using Transformer 30 May 2021 · 1 repository · arXiv:2105.14424
-
Drop Clause: Enhancing Performance, Interpretability and Robustness of the Tsetlin Machine 30 May 2021 · 7 repositories · arXiv:2105.14506
-
LRTuner: A Learning Rate Tuner for Deep Neural Networks 30 May 2021 · 2 repositories · arXiv:2105.14526
-
LEAP: Learnable Pruning for Transformer-based Models 30 May 2021 · 1 repository · arXiv:2105.14636Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search 30 May 2021 · 0 repositories · arXiv:2105.14444
-
Neural Models for Offensive Language Detection 30 May 2021 · 0 repositories · arXiv:2106.14609
-
TransMatcher: Deep Image Matching Through Transformers for Generalizable Person Re-identification 30 May 2021 · 2 repositories · arXiv:2105.14432Syntology official (archive's flag): 5 ran · 13 ran (of which 4 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 21 harvested samples) · 1 pointer-only (licence)
-
Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video 30 May 2021 · 1 repository · arXiv:2105.14520
-
A Simple Voting Mechanism for Online Sexist Content Identification 29 May 2021 · 0 repositories · arXiv:2105.14309
-
Constructing Flow Graphs from Procedural Cybersecurity Texts 29 May 2021 · 1 repository · arXiv:2105.14357
-
FoveaTer: Foveated Transformer for Image Classification 29 May 2021 · 0 repositories · arXiv:2105.14173
-
Korean-English Machine Translation with Multiple Tokenization Strategy 29 May 2021 · 1 repository · arXiv:2105.14274
-
Less is More: Pay Less Attention in Vision Transformers 29 May 2021 · 2 repositories · arXiv:2105.14217
-
Sentiment analysis in tweets: an assessment study from classical to modern text representation models 29 May 2021 · 1 repository · arXiv:2105.14373
-
M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformers 29 May 2021 · 0 repositories · arXiv:2105.14211
-
Accelerating BERT Inference for Sequence Labeling via Early-Exit 28 May 2021 · 1 repository · arXiv:2105.13878
-
An Attention Free Transformer 28 May 2021 · 11 repositories · arXiv:2105.14103Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
ByT5: Towards a token-free future with pre-trained byte-to-byte models 28 May 2021 · 5 repositories · arXiv:2105.13626Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
Compositionally restricted attention-based network for materials property predictions 28 May 2021 · 1 repository
-
Domain-Adaptive Pretraining Methods for Dialogue Understanding 28 May 2021 · 0 repositories · arXiv:2105.13665
-
Hierarchical Transformer Encoders for Vietnamese Spelling Correction 28 May 2021 · 1 repository · arXiv:2105.13578
-
Knowledge Inheritance for Pre-trained Language Models 28 May 2021 · 2 repositories · arXiv:2105.13880
-
KVT: k-NN Attention for Boosting Vision Transformers 28 May 2021 · 1 repository · arXiv:2106.00515Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer 28 May 2021 · 1 repository · arXiv:2105.13993
-
Reinforcement Learning for on-line Sequence Transformation 28 May 2021 · 0 repositories · arXiv:2105.14097
-
ResT: An Efficient Transformer for Visual Recognition 28 May 2021 · 5 repositories · arXiv:2105.13677Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
SciFive: a text-to-text transformer model for biomedical literature 28 May 2021 · 1 repository · arXiv:2106.03598Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Towards mental time travel: a hierarchical memory for reinforcement learning agents 28 May 2021 · 5 repositories · arXiv:2105.14039Syntology official (archive's flag): 1 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
TransCamP: Graph Transformer for 6-DoF Camera Pose Estimation 28 May 2021 · 0 repositories · arXiv:2105.14065
-
Transformer-Based Source-Free Domain Adaptation 28 May 2021 · 1 repository · arXiv:2105.14138
-
Weighted Training for Cross-Task Learning 28 May 2021 · 1 repository · arXiv:2105.14095Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Contrastive Fine-tuning Improves Robustness for Neural Rankers 27 May 2021 · 0 repositories · arXiv:2105.12932
-
Diagnosing Transformers in Task-Oriented Semantic Parsing 27 May 2021 · 0 repositories · arXiv:2105.13496
-
Generative Adversarial Imitation Learning for Empathy-based AI 27 May 2021 · 0 repositories · arXiv:2105.13328
-
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation? 27 May 2021 · 0 repositories · arXiv:2105.12900
-
Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention 27 May 2021 · 2 repositories · arXiv:2105.13495Syntology official (archive's flag): 3 ran · 13 ran (of which 11 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples) · 15 pointer-only (licence)
-
Leveraging Linguistic Coordination in Reranking N-Best Candidates For End-to-End Response Selection Using BERT 27 May 2021 · 0 repositories · arXiv:2105.13479
-
MixQA: Embedding and Answer Mixing for Question Answering 27 May 2021 · 0 repositories
-
Path-based knowledge reasoning with textual semantic information for medical knowledge graph completion 27 May 2021 · 0 repositories · arXiv:2105.13074
-
RAW-C: Relatedness of Ambiguous Words--in Context (A New Lexical Resource for English) 27 May 2021 · 1 repository · arXiv:2105.13266
-
Selective Knowledge Distillation for Neural Machine Translation 27 May 2021 · 1 repository · arXiv:2105.12967Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Verb Sense Clustering using Contextualized Word Representations for Semantic Frame Induction 27 May 2021 · 0 repositories · arXiv:2105.13465
-
A Full-Stack Search Technique for Domain Optimized Deep Learning Accelerators 26 May 2021 · 0 repositories · arXiv:2105.12842
-
Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual Understanding 26 May 2021 · 6 repositories · arXiv:2105.12723Syntology official (archive's flag): 9 ran · 19 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 1 honoured, 1 violated, 16 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 26 harvested samples) · 6 pointer-only (licence)
-
BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition 26 May 2021 · 2 repositories · arXiv:2105.12848Syntology official (archive's flag): 7 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 10 unverified (of 20 harvested samples)
-
Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation 26 May 2021 · 1 repository · arXiv:2105.12523
-
BioNavi-NP: Biosynthesis Navigator for Natural Products 26 May 2021 · 0 repositories · arXiv:2105.13121
-
CogView: Mastering Text-to-Image Generation via Transformers 26 May 2021 · 4 repositories · arXiv:2105.13290Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Deception detection in text and its relation to the cultural dimension of individualism/collectivism 26 May 2021 · 0 repositories · arXiv:2105.12530
-
Sequence Parallelism: Long Sequence Training from System Perspective 26 May 2021 · 0 repositories · arXiv:2105.13120
-
Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading 26 May 2021 · 1 repository · arXiv:2105.12825Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Zero-shot Medical Entity Retrieval without Annotation: Learning From Rich Knowledge Graph Semantics 26 May 2021 · 0 repositories · arXiv:2105.12682
-
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer 25 May 2021 · 1 repository · arXiv:2105.11741
-
Context-Sensitive Visualization of Deep Learning Natural Language Processing Models 25 May 2021 · 0 repositories · arXiv:2105.12202
-
Enhance Multimodal Model Performance with Data Augmentation: Facebook Hateful Meme Challenge Solution 25 May 2021 · 1 repository · arXiv:2105.13132
-
Extending the Abstraction of Personality Types based on MBTI with Machine Learning and Natural Language Processing 25 May 2021 · 0 repositories · arXiv:2105.11798
-
Multi-Task Learning of Generation and Classification for Emotion-Aware Dialogue Response Generation 25 May 2021 · 0 repositories · arXiv:2105.11696
-
NukeLM: Pre-Trained and Fine-Tuned Language Models for the Nuclear and Energy Domains 25 May 2021 · 0 repositories · arXiv:2105.12192
-
Personalized Transformer for Explainable Recommendation 25 May 2021 · 1 repository · arXiv:2105.11601Syntology official (archive's flag): 6 ran · 6 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)