Methods › General › Attention Mechanisms › Attention › Papers, page 283
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 283 of 316: papers 28,201 to 28,300 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Out of Order: How Important Is The Sequential Order of Words in a Sentence in Natural Language Understanding Tasks? 30 Dec 2020 · 0 repositories · arXiv:2012.15180
-
SemGloVe: Semantic Co-occurrences for GloVe from BERT 30 Dec 2020 · 3 repositories · arXiv:2012.15197
-
Transformer for Image Quality Assessment 30 Dec 2020 · 0 repositories · arXiv:2101.01097
-
UnNatural Language Inference 30 Dec 2020 · 1 repository · arXiv:2101.00010
-
A Hierarchical Transformer with Speaker Modeling for Emotion Recognition in Conversation 29 Dec 2020 · 1 repository · arXiv:2012.14781
-
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps 29 Dec 2020 · 2 repositories · arXiv:2012.14966Syntology official (archive's flag): 16 ran · 16 ran (of which 9 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 7 where Syntology's instrument failed) · 7 unverified (of 23 harvested samples)
-
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding 29 Dec 2020 · 9 repositories · arXiv:2012.14740
-
Multiple Structural Priors Guided Self Attention Network for Language Understanding 29 Dec 2020 · 0 repositories · arXiv:2012.14642
-
Robust Dialogue Utterance Rewriting as Sequence Tagging 29 Dec 2020 · 1 repository · arXiv:2012.14535
-
Code Summarization with Structure-induced Transformer 29 Dec 2020 · 1 repository · arXiv:2012.14710
-
A Paragraph-level Multi-task Learning Model for Scientific Fact-Verification 28 Dec 2020 · 1 repository · arXiv:2012.14500
-
BURT: BERT-inspired Universal Representation from Learning Meaningful Segment 28 Dec 2020 · 0 repositories · arXiv:2012.14320
-
Lattice-Free MMI Adaptation Of Self-Supervised Pretrained Acoustic Models 28 Dec 2020 · 2 repositories · arXiv:2012.14252
-
Red Dragon AI at TextGraphs 2020 Shared Task: LIT : LSTM-Interleaved Transformer for Multi-Hop Explanation Ranking 28 Dec 2020 · 1 repository · arXiv:2012.14164
-
Syntax-Enhanced Pre-trained Model 28 Dec 2020 · 1 repository · arXiv:2012.14116
-
TransPose: Keypoint Localization via Transformer 28 Dec 2020 · 1 repository · arXiv:2012.14214
-
A multi-task learning network using shared BERT models for aspect-based sentiment analysis 27 Dec 2020 · 0 repositories
-
ALP-KD: Attention-Based Layer Projection for Knowledge Distillation 27 Dec 2020 · 0 repositories · arXiv:2012.14022
-
An Embarrassingly Simple Model for Dialogue Relation Extraction 27 Dec 2020 · 1 repository · arXiv:2012.13873
-
Inserting Information Bottlenecks for Attribution in Transformers 27 Dec 2020 · 1 repository · arXiv:2012.13838
-
Learning Light-Weight Translation Models from Deep Transformer 27 Dec 2020 · 1 repository · arXiv:2012.13866Syntology official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 1 pointer-only (licence)
-
MeDAL: Medical Abbreviation Disambiguation Dataset for Natural Language Understanding Pretraining 27 Dec 2020 · 1 repository · arXiv:2012.13978
-
Portfolio Optimization with 2D Relative-Attentional Gated Transformer 27 Dec 2020 · 0 repositories · arXiv:2101.03138
-
SG-Net: Syntax Guided Transformer for Language Representation 27 Dec 2020 · 0 repositories · arXiv:2012.13915
-
Detecting Hateful Memes Using a Multimodal Deep Ensemble 24 Dec 2020 · 1 repository · arXiv:2012.13235
-
I like fish, especially dolphins: Addressing Contradictions in Dialogue Modeling 24 Dec 2020 · 0 repositories · arXiv:2012.13391
-
On the Granularity of Explanations in Model Agnostic NLP Interpretability 24 Dec 2020 · 1 repository · arXiv:2012.13189
-
To what extent do human explanations of model behavior align with actual model behavior? 24 Dec 2020 · 0 repositories · arXiv:2012.13354
-
A Survey on Visual Transformer 23 Dec 2020 · 0 repositories · arXiv:2012.12556
-
Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing 23 Dec 2020 · 2 repositories · arXiv:2012.12627
-
Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge 23 Dec 2020 · 1 repository · arXiv:2012.12975
-
Future-Guided Incremental Transformer for Simultaneous Translation 23 Dec 2020 · 0 repositories · arXiv:2012.12465
-
Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphs 23 Dec 2020 · 1 repository · arXiv:2012.13023
-
Training data-efficient image transformers & distillation through attention 23 Dec 2020 · 40 repositories · arXiv:2012.12877Syntology community repositories only · 12 ran (of which 1 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 19 harvested samples) · 3 pointer-only (licence)
-
Applying Wav2vec2.0 to Speech Recognition in Various Low-resource Languages 22 Dec 2020 · 0 repositories · arXiv:2012.12121
-
Domain Adaptation of NMT models for English-Hindi Machine Translation Task at AdapMT ICON 2020 22 Dec 2020 · 0 repositories · arXiv:2012.12112
-
Improved Biomedical Word Embeddings in the Transformer Era 22 Dec 2020 · 1 repository · arXiv:2012.11808
-
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning 22 Dec 2020 · 2 repositories · arXiv:2012.13255Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems 22 Dec 2020 · 1 repository · arXiv:2012.11937
-
Molecular CT: Unifying Geometry and Representation Learning for Molecules at Different Scales 22 Dec 2020 · 0 repositories · arXiv:2012.11816
-
Multi-Head Self-Attention with Role-Guided Masks 22 Dec 2020 · 1 repository · arXiv:2012.12366
-
Recognizing Emotion Cause in Conversations 22 Dec 2020 · 1 repository · arXiv:2012.11820
-
Uncertainty and Surprisal Jointly Deliver the Punchline: Exploiting Incongruity-Based Features for Humor Recognition 22 Dec 2020 · 0 repositories · arXiv:2012.12007
-
3D Object Detection with Pointformer 21 Dec 2020 · 1 repository · arXiv:2012.11409
-
A Graph Reasoning Network for Multi-turn Response Selection via Customized Pre-training 21 Dec 2020 · 0 repositories · arXiv:2012.11099
-
Cross-domain Retrieval in the Legal and Patent Domains: a Reproducibility Study 21 Dec 2020 · 1 repository · arXiv:2012.11405
-
Domain specific BERT representation for Named Entity Recognition of lab protocol 21 Dec 2020 · 1 repository · arXiv:2012.11145
-
Encoding Syntactic Knowledge in Transformer Encoder for Intent Detection and Slot Filling 21 Dec 2020 · 0 repositories · arXiv:2012.11689
-
RealFormer: Transformer Likes Residual Attention 21 Dec 2020 · 5 repositories · arXiv:2012.11747
-
Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization 21 Dec 2020 · 1 repository · arXiv:2012.11204
-
Sub-Linear Memory: How to Make Performers SLiM 21 Dec 2020 · 2 repositories · arXiv:2012.11346
-
Towards Incorporating Entity-specific Knowledge Graph Information in Predicting Drug-Drug Interactions 21 Dec 2020 · 0 repositories · arXiv:2012.11142
-
A hybrid deep-learning approach for complex biochemical named entity recognition 20 Dec 2020 · 0 repositories · arXiv:2012.10824
-
Adaptive Bi-directional Attention: Exploring Multi-Granularity Representations for Machine Reading Comprehension 20 Dec 2020 · 0 repositories · arXiv:2012.10877
-
Multi-Head Linear Attention Generative Adversarial Network for Thin Cloud Removal 20 Dec 2020 · 0 repositories · arXiv:2012.10898
-
Breaking Writer's Block: Low-cost Fine-tuning of Natural Language Generation Models 19 Dec 2020 · 0 repositories · arXiv:2101.03216
-
An Empirical Study of Using Pre-trained BERT Models for Vietnamese Relation Extraction Task at VLSP 2020 18 Dec 2020 · 1 repository · arXiv:2012.10275
-
HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection 18 Dec 2020 · 6 repositories · arXiv:2012.10289
-
NeurST: Neural Speech Translation Toolkit 18 Dec 2020 · 1 repository · arXiv:2012.10018
-
On Modality Bias in the TVQA Dataset 18 Dec 2020 · 1 repository · arXiv:2012.10210
-
Regularized Attentive Capsule Network for Overlapped Relation Extraction 18 Dec 2020 · 0 repositories · arXiv:2012.10187
-
Toward Streaming ASR with Non-Autoregressive Insertion-based Model 18 Dec 2020 · 0 repositories · arXiv:2012.10128
-
A Generalization of Transformer Networks to Graphs 17 Dec 2020 · 3 repositories · arXiv:2012.09699Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
A White Box Analysis of ColBERT 17 Dec 2020 · 0 repositories · arXiv:2012.09650
-
BERT Goes Shopping: Comparing Distributional Models for Product Representations 17 Dec 2020 · 1 repository · arXiv:2012.09807
-
End-to-end Deep Object Tracking with Circular Loss Function for Rotated Bounding Box 17 Dec 2020 · 0 repositories · arXiv:2012.09771
-
Literature Retrieval for Precision Medicine with Neural Matching and Faceted Summarization 17 Dec 2020 · 1 repository · arXiv:2012.09355
-
MASKER: Masked Keyword Regularization for Reliable Text Classification 17 Dec 2020 · 1 repository · arXiv:2012.09392
-
MIX : a Multi-task Learning Approach to Solve Open-Domain Question Answering 17 Dec 2020 · 0 repositories · arXiv:2012.09766
-
PCT: Point cloud transformer 17 Dec 2020 · 11 repositories · arXiv:2012.09688Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
SceneFormer: Indoor Scene Generation with Transformers 17 Dec 2020 · 2 repositories · arXiv:2012.09793
-
Taming Transformers for High-Resolution Image Synthesis 17 Dec 2020 · 13 repositories · arXiv:2012.09841Syntology official (archive's flag): 2 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 4 pointer-only (licence)
-
Toward Transformer-Based Object Detection 17 Dec 2020 · 0 repositories · arXiv:2012.09958
-
Transformer Interpretability Beyond Attention Visualization 17 Dec 2020 · 3 repositories · arXiv:2012.09838Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
A Lightweight Neural Model for Biomedical Entity Linking 16 Dec 2020 · 1 repository · arXiv:2012.08844
-
DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognition 16 Dec 2020 · 4 repositories · arXiv:2012.08695
-
Learning from Mistakes: Using Mis-predictions as Harm Alerts in Language Pre-Training 16 Dec 2020 · 0 repositories · arXiv:2012.08789
-
Point Transformer 16 Dec 2020 · 24 repositories · arXiv:2012.09164
-
Query expansion with artificially generated texts 16 Dec 2020 · 0 repositories · arXiv:2012.08787
-
R²-Net: Relation of Relation Learning Network for Sentence Semantic Matching 16 Dec 2020 · 0 repositories · arXiv:2012.08920
-
Revisiting Linformer with a modified self-attention with linear complexity 16 Dec 2020 · 0 repositories · arXiv:2101.10277
-
High throughput screening with machine learning 15 Dec 2020 · 0 repositories · arXiv:2012.08275
-
Pre-Training Transformers as Energy-Based Cloze Models 15 Dec 2020 · 1 repository · arXiv:2012.08561
-
RecipeNLG: A Cooking Recipes Dataset for Semi-Structured Text Generation 15 Dec 2020 · 1 repository
-
Traditional IR rivals neural models on the MS MARCO Document Ranking Leaderboard 15 Dec 2020 · 2 repositories · arXiv:2012.08020
-
Contrastive Learning with Adversarial Perturbations for Conditional Text Generation 14 Dec 2020 · 1 repository · arXiv:2012.07280Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Extracting Training Data from Large Language Models 14 Dec 2020 · 3 repositories · arXiv:2012.07805Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Few Shot Adaptive Normalization Driven Multi-Speaker Speech Synthesis 14 Dec 2020 · 0 repositories · arXiv:2012.07252
-
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting 14 Dec 2020 · 14 repositories · arXiv:2012.07436Syntology official: harvested, nothing ran · 62 ran (of which 53 constructed an object rather than computing a result; 62 with no instrument failure: 0 honoured, 1 violated, 61 with no contract checked; 0 where Syntology's instrument failed) · 14 unverified (of 76 harvested samples) · 13 pointer-only (licence)
-
LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding 14 Dec 2020 · 0 repositories · arXiv:2012.07335
-
Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension 14 Dec 2020 · 1 repository · arXiv:2012.07410
-
Vartani Spellcheck -- Automatic Context-Sensitive Spelling Correction of OCR-generated Hindi Text Using BERT and Levenshtein Distance 14 Dec 2020 · 0 repositories · arXiv:2012.07652
-
Discriminative Pre-training for Low Resource Title Compression in Conversational Grocery 13 Dec 2020 · 0 repositories · arXiv:2012.06943
-
Improving Image Captioning by Leveraging Intra- and Inter-layer Global Representation in Transformer Network 13 Dec 2020 · 1 repository · arXiv:2012.07061
-
KVL-BERT: Knowledge Enhanced Visual-and-Linguistic BERT for Visual Commonsense Reasoning 13 Dec 2020 · 0 repositories · arXiv:2012.07000
-
MiniVLM: A Smaller and Faster Vision-Language Model 13 Dec 2020 · 0 repositories · arXiv:2012.06946
-
CogALex-VI Shared Task: Transrelation - A Robust Multilingual Language Model for Multilingual Relation Identification 12 Dec 2020 · 1 repository
-
DETR for Crowd Pedestrian Detection 12 Dec 2020 · 1 repository · arXiv:2012.06785
-
Yelp Review Rating Prediction: Machine Learning and Deep Learning Models 12 Dec 2020 · 1 repository · arXiv:2012.06690
-
Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment 11 Dec 2020 · 0 repositories · arXiv:2012.06373