Methods › General › Attention Mechanisms › Attention › Papers, page 301
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 301 of 316: papers 30,001 to 30,100 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Transformer Reasoning Network for Image-Text Matching and Retrieval 20 Apr 2020 · 1 repository · arXiv:2004.09144Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 1 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 2 pointer-only (licence)
-
End-to-End Whisper to Natural Speech Conversion using Modified Transformer Network 20 Apr 2020 · 0 repositories · arXiv:2004.09347
-
Enhancing Pharmacovigilance with Drug Reviews and Social Media 18 Apr 2020 · 1 repository · arXiv:2004.08731
-
Motion Segmentation using Frequency Domain Transformer Networks 18 Apr 2020 · 1 repository · arXiv:2004.08638
-
Enriching the Transformer with Linguistic Factors for Low-Resource Machine Translation 17 Apr 2020 · 0 repositories · arXiv:2004.08053
-
ETC: Encoding Long and Structured Inputs in Transformers 17 Apr 2020 · 2 repositories · arXiv:2004.08483Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning 17 Apr 2020 · 1 repository · arXiv:2004.08097Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Highway Transformer: Self-Gating Enhanced Self-Attentive Networks 17 Apr 2020 · 1 repository · arXiv:2004.08178Syntology official (archive's flag): 4 ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 9 harvested samples)
-
Learning-to-Rank with BERT in TF-Ranking 17 Apr 2020 · 0 repositories · arXiv:2004.08476
-
Too Many Claims to Fact-Check: Prioritizing Political Claims Based on Check-Worthiness 17 Apr 2020 · 0 repositories · arXiv:2004.08166
-
Transform and Tell: Entity-Aware News Image Captioning 17 Apr 2020 · 1 repository · arXiv:2004.08070Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Understanding the Difficulty of Training Transformers 17 Apr 2020 · 2 repositories · arXiv:2004.08249Syntology official (archive's flag): 1 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Cross-lingual Contextualized Topic Models with Zero-shot Learning 16 Apr 2020 · 2 repositories · arXiv:2004.07737Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Non-Autoregressive Machine Translation with Latent Alignments 16 Apr 2020 · 2 repositories · arXiv:2004.07437Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
The Right Tool for the Job: Matching Model and Instance Complexities 16 Apr 2020 · 1 repository · arXiv:2004.07453Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
Towards Instance-Level Parser Selection for Cross-Lingual Transfer of Dependency Parsers 16 Apr 2020 · 0 repositories · arXiv:2004.07642
-
Coreferential Reasoning Learning for Language Representation 15 Apr 2020 · 2 repositories · arXiv:2004.06870
-
SPECTER: Document-level Representation Learning using Citation-informed Transformers 15 Apr 2020 · 5 repositories · arXiv:2004.07180Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Entities as Experts: Sparse Memory Access with Entity Supervision 15 Apr 2020 · 1 repository · arXiv:2004.07202Syntology 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 14 pointer-only (licence)
-
lamBERT: Language and Action Learning Using Multimodal BERT 15 Apr 2020 · 0 repositories · arXiv:2004.07093
-
Sentiment Analysis of Yelp Reviews: A Comparison of Techniques and Models 15 Apr 2020 · 1 repository · arXiv:2004.13851
-
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue 15 Apr 2020 · 1 repository · arXiv:2004.06871Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified (of 13 harvested samples) · 13 pointer-only (licence)
-
Training with Quantization Noise for Extreme Model Compression 15 Apr 2020 · 4 repositories · arXiv:2004.07320
-
A Simple Yet Strong Pipeline for HotpotQA 14 Apr 2020 · 0 repositories · arXiv:2004.06753
-
Deep Learning Models for Multilingual Hate Speech Detection 14 Apr 2020 · 3 repositories · arXiv:2004.06465
-
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation 14 Apr 2020 · 2 repositories · arXiv:2004.07159
-
CrisisBench: Benchmarking Crisis-related Social Media Datasets for Humanitarian Information Processing 14 Apr 2020 · 0 repositories · arXiv:2004.06774
-
Transformer based Grapheme-to-Phoneme Conversion 14 Apr 2020 · 1 repository · arXiv:2004.06338
-
What's so special about BERT's layers? A closer look at the NLP pipeline in monolingual and multilingual models 14 Apr 2020 · 2 repositories · arXiv:2004.06499Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Cascade Neural Ensemble for Identifying Scientifically Sound Articles 13 Apr 2020 · 0 repositories · arXiv:2004.06222
-
Improving Scholarly Knowledge Representation: Evaluating BERT-based Models for Scientific Relation Classification 13 Apr 2020 · 0 repositories · arXiv:2004.06153
-
Pretrained Transformers Improve Out-of-Distribution Robustness 13 Apr 2020 · 1 repository · arXiv:2004.06100
-
ProFormer: Towards On-Device LSH Projection Based Transformers 13 Apr 2020 · 0 repositories · arXiv:2004.05801
-
Will I Sound Like Me? Improving Persona Consistency in Dialogues through Pragmatic Self-Consciousness 13 Apr 2020 · 1 repository · arXiv:2004.05816Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Relation Transformer Network 13 Apr 2020 · 1 repository · arXiv:2004.06193
-
Robustly Pre-trained Neural Model for Direct Temporal Relation Extraction 13 Apr 2020 · 0 repositories · arXiv:2004.06216
-
Unified Multi-Criteria Chinese Word Segmentation with BERT 13 Apr 2020 · 0 repositories · arXiv:2004.05808
-
AMR Parsing via Graph-Sequence Iterative Inference 12 Apr 2020 · 3 repositories · arXiv:2004.05572Syntology official (archive's flag): 4 ran · 21 ran (of which 11 constructed an object rather than computing a result; 16 with no instrument failure: 1 honoured, 1 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 10 unverified (of 31 harvested samples) · 1 pointer-only (licence)
-
Pre-training Text Representations as Meta Learning 12 Apr 2020 · 0 repositories · arXiv:2004.05568
-
Relational Learning between Multiple Pulmonary Nodules via Deep Set Attention Transformers 12 Apr 2020 · 0 repositories · arXiv:2004.05640
-
VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification 12 Apr 2020 · 1 repository · arXiv:2004.05707Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
End to End Chinese Lexical Fusion Recognition with Sememe Knowledge 11 Apr 2020 · 0 repositories · arXiv:2004.05456
-
LAReQA: Language-agnostic answer retrieval from a multilingual pool 11 Apr 2020 · 1 repository · arXiv:2004.05484
-
An In-depth Walkthrough on Evolution of Neural Machine Translation 10 Apr 2020 · 0 repositories · arXiv:2004.04902
-
Longformer: The Long-Document Transformer 10 Apr 2020 · 22 repositories · arXiv:2004.05150Syntology official (archive's flag): 9 ran · 22 ran (of which 4 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 1 violated, 12 with no contract checked; 8 where Syntology's instrument failed) · 13 unverified (of 35 harvested samples) · 5 pointer-only (licence)
-
Beyond Fine-tuning: Few-Sample Sentence Embedding Transfer 10 Apr 2020 · 0 repositories · arXiv:2004.05119
-
Stacked Convolutional Deep Encoding Network for Video-Text Retrieval 10 Apr 2020 · 0 repositories · arXiv:2004.04959
-
Telling BERT's full story: from Local Attention to Global Aggregation 10 Apr 2020 · 0 repositories · arXiv:2004.05916
-
BLEURT: Learning Robust Metrics for Text Generation 9 Apr 2020 · 4 repositories · arXiv:2004.04696Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Cortical surface registration using unsupervised learning 9 Apr 2020 · 1 repository · arXiv:2004.04617
-
Interpretability Analysis for Named Entity Recognition to Understand System Predictions and How They Can Improve 9 Apr 2020 · 0 repositories · arXiv:2004.04564
-
On Optimal Transformer Depth for Low-Resource Language Translation 9 Apr 2020 · 1 repository · arXiv:2004.04418
-
On the Language Neutrality of Pre-trained Multilingual Representations 9 Apr 2020 · 1 repository · arXiv:2004.05160Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Sequential View Synthesis with Transformer 9 Apr 2020 · 0 repositories · arXiv:2004.04548
-
Adaptive Transformers in RL 8 Apr 2020 · 1 repository · arXiv:2004.03761
-
DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement 8 Apr 2020 · 1 repository · arXiv:2004.03760
-
Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation 8 Apr 2020 · 1 repository · arXiv:2004.03875
-
DynaBERT: Dynamic BERT with Adaptive Width and Depth 8 Apr 2020 · 3 repositories · arXiv:2004.04037Syntology official (archive's flag): 5 ran · 5 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Error correction and extraction in request dialogs 8 Apr 2020 · 0 repositories · arXiv:2004.04243
-
Analyzing Redundancy in Pretrained Transformer Models 8 Apr 2020 · 1 repository · arXiv:2004.04010
-
Generating Counter Narratives against Online Hate Speech: Data and Strategies 8 Apr 2020 · 0 repositories · arXiv:2004.04216
-
Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic Fidelity 8 Apr 2020 · 1 repository · arXiv:2004.06577
-
Improving BERT with Self-Supervised Attention 8 Apr 2020 · 1 repository · arXiv:2004.03808
-
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression 8 Apr 2020 · 0 repositories · arXiv:2004.04124
-
On the Effect of Dropping Layers of Pre-trained Transformer Models 8 Apr 2020 · 4 repositories · arXiv:2004.03844Syntology official (archive's flag): 5 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherence 8 Apr 2020 · 3 repositories · arXiv:2004.03974Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
SciWING -- A Software Toolkit for Scientific Document Processing 8 Apr 2020 · 1 repository · arXiv:2004.03807
-
Severing the Edge Between Before and After: Neural Architectures for Temporal Ordering of Events 8 Apr 2020 · 0 repositories · arXiv:2004.04295
-
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition 7 Apr 2020 · 1 repository · arXiv:2004.03066Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Byte Pair Encoding is Suboptimal for Language Model Pretraining 7 Apr 2020 · 1 repository · arXiv:2004.03720
-
TuringAdvice: A Generative and Dynamic Evaluation of Language Use 7 Apr 2020 · 1 repository · arXiv:2004.03607
-
Information-Theoretic Probing for Linguistic Structure 7 Apr 2020 · 1 repository · arXiv:2004.03061Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Probabilistic Spatial Transformer Networks 7 Apr 2020 · 1 repository · arXiv:2004.03637
-
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases 7 Apr 2020 · 1 repository · arXiv:2004.03125Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots 7 Apr 2020 · 2 repositories · arXiv:2004.03588
-
TextGAIL: Generative Adversarial Imitation Learning for Text Generation 7 Apr 2020 · 0 repositories · arXiv:2004.13796
-
The Russian Drug Reaction Corpus and Neural Models for Drug Reactions and Effectiveness Detection in User Reviews 7 Apr 2020 · 1 repository · arXiv:2004.03659
-
Towards Evaluating the Robustness of Chinese BERT Classifiers 7 Apr 2020 · 0 repositories · arXiv:2004.03742
-
Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation 7 Apr 2020 · 0 repositories · arXiv:2004.03097
-
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-based Question Answering 7 Apr 2020 · 1 repository · arXiv:2004.03561
-
A Systematic Analysis of Morphological Content in BERT Models for Multiple Languages 6 Apr 2020 · 1 repository · arXiv:2004.03032
-
AutoToon: Automatic Geometric Warping for Face Cartoon Generation 6 Apr 2020 · 1 repository · arXiv:2004.02377
-
Bootstrapping a Crosslingual Semantic Parser 6 Apr 2020 · 1 repository · arXiv:2004.02585
-
DARE: Data Augmented Relation Extraction with GPT-2 6 Apr 2020 · 0 repositories · arXiv:2004.13845
-
Enhancing Review Comprehension with Domain-Specific Commonsense 6 Apr 2020 · 0 repositories · arXiv:2004.03020
-
Leveraging the Inherent Hierarchy of Vacancy Titles for Automated Job Ontology Expansion 6 Apr 2020 · 0 repositories · arXiv:2004.02814
-
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices 6 Apr 2020 · 7 repositories · arXiv:2004.02984
-
Sparse Text Generation 6 Apr 2020 · 1 repository · arXiv:2004.02644
-
FastBERT: a Self-distilling BERT with Adaptive Inference Time 5 Apr 2020 · 3 repositories · arXiv:2004.02178Syntology community repositories only · 6 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
Continual Domain-Tuning for Pretrained Language Models 5 Apr 2020 · 0 repositories · arXiv:2004.02288
-
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space 5 Apr 2020 · 1 repository · arXiv:2004.04092
-
Syntax-driven Iterative Expansion Language Models for Controllable Text Generation 5 Apr 2020 · 0 repositories · arXiv:2004.02211
-
A Dependency Syntactic Knowledge Augmented Interactive Architecture for End-to-End Aspect-based Sentiment Analysis 4 Apr 2020 · 3 repositories · arXiv:2004.01951
-
CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection 4 Apr 2020 · 0 repositories · arXiv:2004.01881
-
Conversational Question Reformulation via Sequence-to-Sequence Architectures and Pretrained Language Models 4 Apr 2020 · 0 repositories · arXiv:2004.01909
-
A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining 4 Apr 2020 · 3 repositories · arXiv:2004.02016
-
Generating Rationales in Visual Question Answering 4 Apr 2020 · 0 repositories · arXiv:2004.02032
-
Pre-training for Abstractive Document Summarization by Reinstating Source Text 4 Apr 2020 · 0 repositories · arXiv:2004.01853
-
Finding Black Cat in a Coal Cellar -- Keyphrase Extraction & Keyphrase-Rubric Relationship Classification from Complex Assignments 3 Apr 2020 · 2 repositories · arXiv:2004.01549
-
LiDAR-based Online 3D Video Object Detection with Graph-based Message Passing and Spatiotemporal Transformer Attention 3 Apr 2020 · 1 repository · arXiv:2004.01389