Methods › General › Attention Mechanisms › Attention › Papers, page 290
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 290 of 316: papers 28,901 to 29,000 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task 11 Oct 2020 · 0 repositories · arXiv:2010.05122
-
SMYRF: Efficient Attention using Asymmetric Clustering 11 Oct 2020 · 1 repository · arXiv:2010.05315Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Unsupervised Distillation of Syntactic Information from Contextualized Word Representations 11 Oct 2020 · 1 repository · arXiv:2010.05265
-
Automated Concatenation of Embeddings for Structured Prediction 10 Oct 2020 · 2 repositories · arXiv:2010.05006
-
Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings 10 Oct 2020 · 0 repositories · arXiv:2010.05002
-
Information Extraction from Swedish Medical Prescriptions with Sig-Transformer Encoder 10 Oct 2020 · 0 repositories · arXiv:2010.04897
-
Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training 10 Oct 2020 · 1 repository · arXiv:2010.05003
-
Structured Self-Attention Weights Encode Semantics in Sentiment Analysis 10 Oct 2020 · 1 repository · arXiv:2010.04922
-
Tag Recommendation for Online Q&A Communities based on BERT Pre-Training Technique 10 Oct 2020 · 1 repository · arXiv:2010.04971
-
Grid Tagging Scheme for Aspect-oriented Fine-grained Opinion Extraction 9 Oct 2020 · 3 repositories · arXiv:2010.04640
-
NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Training 9 Oct 2020 · 1 repository · arXiv:2010.04335
-
On Task-Level Dialogue Composition of Generative Transformer Model 9 Oct 2020 · 1 repository · arXiv:2010.04826
-
Online Back-Parsing for AMR-to-Text Generation 9 Oct 2020 · 1 repository · arXiv:2010.04520
-
Style Attuned Pre-training and Parameter Efficient Fine-tuning for Spoken Language Understanding 9 Oct 2020 · 0 repositories · arXiv:2010.04355
-
The NU Voice Conversion System for the Voice Conversion Challenge 2020: On the Effectiveness of Sequence-to-sequence Models and Autoregressive Neural Vocoders 9 Oct 2020 · 0 repositories · arXiv:2010.04446
-
Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis 9 Oct 2020 · 1 repository · arXiv:2010.04543
-
What Have We Achieved on Text Summarization? 9 Oct 2020 · 1 repository · arXiv:2010.04529
-
A Co-Interactive Transformer for Joint Slot Filling and Intent Detection 8 Oct 2020 · 1 repository · arXiv:2010.03880
-
Automatic generation of reviews of scientific papers 8 Oct 2020 · 1 repository · arXiv:2010.04147
-
Deep Learning Meets Projective Clustering 8 Oct 2020 · 0 repositories · arXiv:2010.04290
-
Deformable DETR: Deformable Transformers for End-to-End Object Detection 8 Oct 2020 · 20 repositories · arXiv:2010.04159Syntology community repositories only · 37 ran (of which 9 constructed an object rather than computing a result; 24 with no instrument failure: 1 honoured, 3 violated, 20 with no contract checked; 13 where Syntology's instrument failed) · 18 unverified (of 55 harvested samples) · 21 pointer-only (licence)
-
Discriminatively-Tuned Generative Classifiers for Robust Natural Language Inference 8 Oct 2020 · 1 repository · arXiv:2010.03760
-
Improving Attention Mechanism with Query-Value Interaction 8 Oct 2020 · 0 repositories · arXiv:2010.03766
-
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition 8 Oct 2020 · 1 repository · arXiv:2010.03746
-
Injecting Word Information with Multi-Level Word Adapter for Chinese Spoken Language Understanding 8 Oct 2020 · 1 repository · arXiv:2010.03903
-
Interlocking Backpropagation: Improving depthwise model-parallelism 8 Oct 2020 · 1 repository · arXiv:2010.04116
-
Leveraging Unpaired Text Data for Training End-to-End Speech-to-Intent Systems 8 Oct 2020 · 0 repositories · arXiv:2010.04284
-
Masked ELMo: An evolution of ELMo towards fully contextual RNN language models 8 Oct 2020 · 0 repositories · arXiv:2010.04302
-
PARADE: A New Dataset for Paraphrase Identification Requiring Computer Science Domain Knowledge 8 Oct 2020 · 1 repository · arXiv:2010.03725
-
Shallow-to-Deep Training for Neural Machine Translation 8 Oct 2020 · 1 repository · arXiv:2010.03737
-
TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling 8 Oct 2020 · 1 repository · arXiv:2010.03802
-
Visual News: Benchmark and Challenges in News Image Captioning 8 Oct 2020 · 1 repository · arXiv:2010.03743
-
Combining Deep Learning and String Kernels for the Localization of Swiss German Tweets 7 Oct 2020 · 0 repositories · arXiv:2010.03614
-
Detecting Fine-Grained Cross-Lingual Semantic Divergences without Supervision by Learning to Rank 7 Oct 2020 · 1 repository · arXiv:2010.03662
-
DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling 7 Oct 2020 · 0 repositories · arXiv:2010.03099
-
ELMo and BERT in semantic change detection for Russian 7 Oct 2020 · 0 repositories · arXiv:2010.03481
-
Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsing 7 Oct 2020 · 1 repository · arXiv:2010.03546
-
AxFormer: Accuracy-driven Approximation of Transformers for Faster, Smaller and more Accurate NLP Models 7 Oct 2020 · 1 repository · arXiv:2010.03688
-
Super-Human Performance in Online Low-latency Recognition of Conversational Speech 7 Oct 2020 · 1 repository · arXiv:2010.03449
-
Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields 7 Oct 2020 · 1 repository · arXiv:2010.03224
-
Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News 7 Oct 2020 · 2 repositories · arXiv:2010.03159Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Why do you think that? Exploring Faithful Sentence-Level Rationales Without Supervision 7 Oct 2020 · 1 repository · arXiv:2010.03384
-
Adversarial Grammatical Error Correction 6 Oct 2020 · 0 repositories · arXiv:2010.02407
-
Analyzing Individual Neurons in Pre-trained Language Models 6 Oct 2020 · 1 repository · arXiv:2010.02695
-
BERT Knows Punta Cana is not just beautiful, it's gorgeous: Ranking Scalar Adjectives with Contextualised Representations 6 Oct 2020 · 1 repository · arXiv:2010.02686
-
Beyond [CLS] through Ranking by Generation 6 Oct 2020 · 0 repositories · arXiv:2010.03073
-
Converting the Point of View of Messages Spoken to Virtual Assistants 6 Oct 2020 · 2 repositories · arXiv:2010.02600
-
Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher 6 Oct 2020 · 1 repository · arXiv:2010.02562
-
Do Explicit Alignments Robustly Improve Multilingual Encoders? 6 Oct 2020 · 1 repository · arXiv:2010.02537
-
Efficient Inference For Neural Machine Translation 6 Oct 2020 · 0 repositories · arXiv:2010.02416
-
Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming 6 Oct 2020 · 1 repository · arXiv:2010.03010Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillation 6 Oct 2020 · 1 repository · arXiv:2010.02666
-
Incorporating Behavioral Hypotheses for Query Generation 6 Oct 2020 · 0 repositories · arXiv:2010.02667
-
Intrinsic Probing through Dimension Selection 6 Oct 2020 · 1 repository · arXiv:2010.02812Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Investigating African-American Vernacular English in Transformer-Based Text Generation 6 Oct 2020 · 1 repository · arXiv:2010.02510
-
LEGAL-BERT: The Muppets straight out of Law School 6 Oct 2020 · 0 repositories · arXiv:2010.02559
-
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation 6 Oct 2020 · 1 repository · arXiv:2010.02705
-
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers 6 Oct 2020 · 0 repositories · arXiv:2010.02616
-
On the Sub-Layer Functionalities of Transformer Decoder 6 Oct 2020 · 0 repositories · arXiv:2010.02648
-
Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder 6 Oct 2020 · 2 repositories · arXiv:2010.02684Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Pretrained Language Model Embryology: The Birth of ALBERT 6 Oct 2020 · 1 repository · arXiv:2010.02480
-
Resource-Enhanced Neural Model for Event Argument Extraction 6 Oct 2020 · 0 repositories · arXiv:2010.03022
-
Scene Graph Modification Based on Natural Language Commands 6 Oct 2020 · 1 repository · arXiv:2010.02591
-
The Multilingual Amazon Reviews Corpus 6 Oct 2020 · 1 repository · arXiv:2010.02573
-
Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications 6 Oct 2020 · 0 repositories · arXiv:2010.08412
-
GenAug: Data Augmentation for Finetuning Text Generators 5 Oct 2020 · 2 repositories · arXiv:2010.01794
-
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers? 5 Oct 2020 · 0 repositories · arXiv:2010.01764
-
Improving AMR Parsing with Sequence-to-Sequence Pre-training 5 Oct 2020 · 1 repository · arXiv:2010.01771
-
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective 5 Oct 2020 · 2 repositories · arXiv:2010.02329Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Linguistic Profiling of a Neural Language Model 5 Oct 2020 · 0 repositories · arXiv:2010.01869
-
Mixup-Transformer: Dynamic Data Augmentation for NLP Tasks 5 Oct 2020 · 0 repositories · arXiv:2010.02394
-
PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation 5 Oct 2020 · 0 repositories · arXiv:2010.02301
-
Pareto Probing: Trading Off Accuracy for Complexity 5 Oct 2020 · 1 repository · arXiv:2010.02180Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
PMI-Masking: Principled masking of correlated spans 5 Oct 2020 · 1 repository · arXiv:2010.01825
-
Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior 5 Oct 2020 · 1 repository · arXiv:2010.01791
-
PUM at SemEval-2020 Task 12: Aggregation of Transformer-based models' features for offensive language recognition 5 Oct 2020 · 0 repositories · arXiv:2010.01897
-
Self-training Improves Pre-training for Natural Language Understanding 5 Oct 2020 · 1 repository · arXiv:2010.02194
-
Transformer-Based Neural Text Generation with Syntactic Guidance 5 Oct 2020 · 1 repository · arXiv:2010.01737
-
Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning 5 Oct 2020 · 1 repository · arXiv:2010.01781
-
X-SRL: A Parallel Cross-Lingual Semantic Role Labeling Dataset 5 Oct 2020 · 1 repository · arXiv:2010.01998
-
An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels 4 Oct 2020 · 1 repository · arXiv:2010.01653Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Inquisitive Question Generation for High Level Text Comprehension 4 Oct 2020 · 1 repository · arXiv:2010.01657
-
On Losses for Modern Language Models 4 Oct 2020 · 1 repository · arXiv:2010.01694
-
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space 4 Oct 2020 · 1 repository · arXiv:2010.01475
-
Mining Knowledge for Natural Language Inference from Wikipedia Categories 3 Oct 2020 · 1 repository · arXiv:2010.01239Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles 3 Oct 2020 · 0 repositories · arXiv:2010.01309
-
Beyond Chemical 1D knowledge using Transformers 2 Oct 2020 · 0 repositories · arXiv:2010.01027
-
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media 2 Oct 2020 · 0 repositories · arXiv:2010.01150
-
Data Transfer Approaches to Improve Seq-to-Seq Retrosynthesis 2 Oct 2020 · 0 repositories · arXiv:2010.00792
-
Data-Efficient Pretraining via Contrastive Self-Supervision 2 Oct 2020 · 0 repositories · arXiv:2010.01061
-
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention 2 Oct 2020 · 9 repositories · arXiv:2010.01057Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 10 harvested samples)
-
MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale 2 Oct 2020 · 1 repository · arXiv:2010.00980
-
STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++ 2 Oct 2020 · 1 repository · arXiv:2010.00760
-
A Compare Aggregate Transformer for Understanding Document-grounded Dialogue 1 Oct 2020 · 0 repositories · arXiv:2010.00190
-
A Technical Question Answering System with Transfer Learning 1 Oct 2020 · 1 repository
-
Beyond The Text: Analysis of Privacy Statements through Syntactic and Semantic Role Labeling 1 Oct 2020 · 0 repositories · arXiv:2010.00678
-
CoLAKE: Contextualized Language and Knowledge Embedding 1 Oct 2020 · 1 repository · arXiv:2010.00309Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Detecting White Supremacist Hate Speech using Domain Specific Word Embedding with Deep Learning and BERT 1 Oct 2020 · 0 repositories · arXiv:2010.00357
-
Evaluating Multilingual BERT for Estonian 1 Oct 2020 · 0 repositories · arXiv:2010.00454
-
Examining the rhetorical capacities of neural language models 1 Oct 2020 · 0 repositories · arXiv:2010.00153