Methods › General › Attention Mechanisms › Attention › Papers, page 310
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 310 of 316: papers 30,901 to 31,000 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Knowledge Enhanced Attention for Robust Natural Language Inference 31 Aug 2019 · 0 repositories · arXiv:1909.00102
-
Modeling Graph Structure in Transformer for Better AMR-to-Text Generation 31 Aug 2019 · 1 repository · arXiv:1909.00136
-
NEZHA: Neural Contextualized Representation for Chinese Language Understanding 31 Aug 2019 · 10 repositories · arXiv:1909.00204
-
Quantity doesn't buy quality syntax with neural language models 31 Aug 2019 · 0 repositories · arXiv:1909.00111
-
Small and Practical BERT Models for Sequence Labeling 31 Aug 2019 · 0 repositories · arXiv:1909.00100
-
Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classification 30 Aug 2019 · 3 repositories · arXiv:1908.11860Syntology official: harvested, nothing ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Adaptively Sparse Transformers 30 Aug 2019 · 3 repositories · arXiv:1909.00015Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Answering Conversational Questions on Structured Data without Logical Forms 30 Aug 2019 · 0 repositories · arXiv:1908.11787
-
Bilingual is At Least Monolingual (BALM): A Novel Translation Algorithm that Encodes Monolingual Priors 30 Aug 2019 · 1 repository · arXiv:1909.01146
-
Pre-training A Neural Language Model Improves The Sample Efficiency of an Emergency Room Classification Model 30 Aug 2019 · 0 repositories · arXiv:1909.01136
-
PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identification 30 Aug 2019 · 3 repositories · arXiv:1908.11828
-
Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernel 30 Aug 2019 · 1 repository · arXiv:1908.11775
-
Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention 29 Aug 2019 · 1 repository · arXiv:1908.11365
-
Probing Representations Learned by Multimodal Recurrent and Transformer Models 29 Aug 2019 · 0 repositories · arXiv:1908.11125
-
Regularized Context Gates on Transformer for Machine Translation 29 Aug 2019 · 0 repositories · arXiv:1908.11020
-
Temporal Consistency Objectives Regularize the Learning of Disentangled Representations 29 Aug 2019 · 1 repository · arXiv:1908.11330
-
Adversarial Representation Learning for Text-to-Image Matching 28 Aug 2019 · 0 repositories · arXiv:1908.10534
-
Solving Math Word Problems with Double-Decoder Transformer 28 Aug 2019 · 0 repositories · arXiv:1908.10924
-
Bridging the Gap for Tokenizer-Free Language Models 27 Aug 2019 · 0 repositories · arXiv:1908.10322
-
FinBERT: Financial Sentiment Analysis with Pre-trained Language Models 27 Aug 2019 · 3 repositories · arXiv:1908.10063Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Multiresolution Transformer Networks: Recurrence is Not Essential for Modeling Hierarchical Structure 27 Aug 2019 · 0 repositories · arXiv:1908.10408
-
On NMT Search Errors and Model Errors: Cat Got Your Tongue? 27 Aug 2019 · 0 repositories · arXiv:1908.10090
-
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks 27 Aug 2019 · 64 repositories · arXiv:1908.10084Syntology community repositories only · 33 ran (of which 9 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 3 where Syntology's instrument failed) · 25 unverified (of 58 harvested samples) · 11 pointer-only (licence)
-
Attentive History Selection for Conversational Question Answering 26 Aug 2019 · 2 repositories · arXiv:1908.09456
-
Detecting Toxicity in News Articles: Application to Bulgarian 26 Aug 2019 · 1 repository · arXiv:1908.09785
-
Does BERT agree? Evaluating knowledge of structure dependence through agreement relations 26 Aug 2019 · 1 repository · arXiv:1908.09892
-
Measuring Patent Claim Generation by Span Relevancy 26 Aug 2019 · 0 repositories · arXiv:1908.09591
-
Patient Knowledge Distillation for BERT Model Compression 25 Aug 2019 · 5 repositories · arXiv:1908.09355Syntology community repositories only · 19 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 2 honoured, 1 violated, 10 with no contract checked; 6 where Syntology's instrument failed) · 8 unverified (of 27 harvested samples) · 27 pointer-only (licence)
-
Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfer 25 Aug 2019 · 1 repository · arXiv:1908.09368
-
BERT for Coreference Resolution: Baselines and Analysis 24 Aug 2019 · 2 repositories · arXiv:1908.09091
-
Release Strategies and the Social Impacts of Language Models 24 Aug 2019 · 0 repositories · arXiv:1908.09203
-
Deep Learning Based Chatbot Models 23 Aug 2019 · 1 repository · arXiv:1908.08835
-
Neural data-to-text generation: A comparison between pipeline and end-to-end architectures 23 Aug 2019 · 1 repository · arXiv:1908.09022
-
Training Optimus Prime, M.D.: Generating Medical Certification Items by Fine-Tuning OpenAI's gpt2 Transformer Model 23 Aug 2019 · 0 repositories · arXiv:1908.08594
-
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models 23 Aug 2019 · 40 repositories · arXiv:1908.08962Syntology community repositories only · 21 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 1 honoured, 0 violated, 15 with no contract checked; 5 where Syntology's instrument failed) · 11 unverified (of 32 harvested samples) · 4 pointer-only (licence)
-
Denoising based Sequence-to-Sequence Pre-training for Text Generation 22 Aug 2019 · 0 repositories · arXiv:1908.08206
-
Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering 22 Aug 2019 · 0 repositories · arXiv:1908.08167
-
Revisiting Semantic Representation and Tree Search for Similar Question Retrieval 22 Aug 2019 · 1 repository · arXiv:1908.08326
-
Text Summarization with Pretrained Encoders 22 Aug 2019 · 19 repositories · arXiv:1908.08345Syntology community repositories only · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 1 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified (of 21 harvested samples) · 5 pointer-only (licence)
-
Compositionality decomposed: how do neural networks generalise? 22 Aug 2019 · 1 repository · arXiv:1908.08351Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
VL-BERT: Pre-training of Generic Visual-Linguistic Representations 22 Aug 2019 · 3 repositories · arXiv:1908.08530Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Improving Neural Machine Translation with Pre-trained Representation 21 Aug 2019 · 0 repositories · arXiv:1908.07688
-
Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Text 21 Aug 2019 · 1 repository · arXiv:1908.07721
-
Revealing the Dark Secrets of BERT 21 Aug 2019 · 0 repositories · arXiv:1908.08593
-
Evaluating Contextualized Embeddings on 54 Languages in POS Tagging, Lemmatization and Dependency Parsing 20 Aug 2019 · 0 repositories · arXiv:1908.07448
-
GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledge 20 Aug 2019 · 3 repositories · arXiv:1908.07245
-
LXMERT: Learning Cross-Modality Encoder Representations from Transformers 20 Aug 2019 · 9 repositories · arXiv:1908.07490Syntology community repositories only · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 15 harvested samples) · 3 pointer-only (licence)
-
Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimation 20 Aug 2019 · 3 repositories · arXiv:1908.07433Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples)
-
Universal Adversarial Triggers for Attacking and Analyzing NLP 20 Aug 2019 · 1 repository · arXiv:1908.07125Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
A Study of BERT for Non-Factoid Question-Answering under Passage Length Constraints 19 Aug 2019 · 0 repositories · arXiv:1908.06780
-
Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models 19 Aug 2019 · 0 repositories · arXiv:1908.06725
-
Encoder-Agnostic Adaptation for Conditional Language Generation 19 Aug 2019 · 1 repository · arXiv:1908.06938
-
Neural Architectures for Nested NER through Linearization 19 Aug 2019 · 1 repository · arXiv:1908.06926
-
EmotionX-IDEA: Emotion BERT -- an Affectional Model for Conversation 17 Aug 2019 · 1 repository · arXiv:1908.06264
-
Hard but Robust, Easy but Sensitive: How Encoder and Decoder Perform in Neural Machine Translation 17 Aug 2019 · 0 repositories · arXiv:1908.06259
-
Language Features Matter: Effective Language Representations for Vision-Language Tasks 17 Aug 2019 · 0 repositories · arXiv:1908.06327
-
BERT-Based Multi-Head Selection for Joint Entity-Relation Extraction 16 Aug 2019 · 1 repository · arXiv:1908.05908
-
CFO: A Framework for Building Production NLP Systems 16 Aug 2019 · 0 repositories · arXiv:1908.06121
-
CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Text 16 Aug 2019 · 5 repositories · arXiv:1908.06177Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
The Transference Architecture for Automatic Post-Editing 16 Aug 2019 · 0 repositories · arXiv:1908.06151
-
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training 16 Aug 2019 · 0 repositories · arXiv:1908.06066
-
Integrating Multimodal Information in Large Pretrained Transformers 15 Aug 2019 · 1 repository · arXiv:1908.05787
-
Temporal Collaborative Ranking Via Personalized Transformer 15 Aug 2019 · 3 repositories · arXiv:1908.05435
-
Towards Making the Most of BERT in Neural Machine Translation 15 Aug 2019 · 2 repositories · arXiv:1908.05672
-
Transformer-based Automatic Post-Editing with a Context-Aware Encoding Approach for Multi-Source Inputs 15 Aug 2019 · 0 repositories · arXiv:1908.05679
-
Visualizing and Understanding the Effectiveness of BERT 15 Aug 2019 · 0 repositories · arXiv:1908.05620
-
Adabot: Fault-Tolerant Java Decompiler 14 Aug 2019 · 0 repositories · arXiv:1908.06748
-
Establishing Strong Baselines for the New Decade: Sequence Tagging, Syntactic and Semantic Parsing with BERT 14 Aug 2019 · 1 repository · arXiv:1908.04943
-
On-Device Text Representations Robust To Misspellings via Projections 14 Aug 2019 · 0 repositories · arXiv:1908.05763
-
Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding 14 Aug 2019 · 1 repository · arXiv:1908.05161
-
SG-Net: Syntax-Guided Machine Reading Comprehension 14 Aug 2019 · 1 repository · arXiv:1908.05147
-
BioFLAIR: Pretrained Pooled Contextualized Embeddings for Biomedical Sequence Labeling Tasks 13 Aug 2019 · 1 repository · arXiv:1908.05760
-
An Effective Domain Adaptive Post-Training Method for BERT in Response Selection 13 Aug 2019 · 1 repository · arXiv:1908.04812
-
Generative Question Refinement with Deep Reinforcement Learning in Retrieval-based QA System 13 Aug 2019 · 1 repository · arXiv:1908.05604
-
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding 13 Aug 2019 · 0 repositories · arXiv:1908.04577
-
Jointly Aligning Millions of Images with Deep Penalised Reconstruction Congealing 12 Aug 2019 · 0 repositories · arXiv:1908.04130
-
On Identifiability in Transformers 12 Aug 2019 · 0 repositories · arXiv:1908.04211
-
TAPER: Time-Aware Patient EHR Representation 11 Aug 2019 · 2 repositories · arXiv:1908.03971Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples)
-
Dense Transformer Networks for Brain Electron Microscopy Image Segmentation 10 Aug 2019 · 0 repositories
-
Multi-modality Latent Interaction Network for Visual Question Answering 10 Aug 2019 · 0 repositories · arXiv:1908.04289
-
BERT-based Ranking for Biomedical Entity Normalization 9 Aug 2019 · 0 repositories · arXiv:1908.03548
-
UdS Submission for the WMT 19 Automatic Post-Editing Task 9 Aug 2019 · 0 repositories · arXiv:1908.03402
-
VisualBERT: A Simple and Performant Baseline for Vision and Language 9 Aug 2019 · 10 repositories · arXiv:1908.03557Syntology 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 6 pointer-only (licence)
-
Fast and Accurate Capitalization and Punctuation for Automatic Speech Recognition Using Transformer and Chunk Merging 7 Aug 2019 · 0 repositories · arXiv:1908.02404
-
TinySearch -- Semantics based Search Engine using Bert Embeddings 7 Aug 2019 · 0 repositories · arXiv:1908.02451
-
Clustering of Deep Contextualized Representations for Summarization of Biomedical Texts 6 Aug 2019 · 1 repository · arXiv:1908.02286
-
Predicting Prosodic Prominence from Text with Pre-trained Contextualized Word Representations 6 Aug 2019 · 1 repository · arXiv:1908.02262
-
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks 6 Aug 2019 · 11 repositories · arXiv:1908.02265Syntology 10 ran (of which 6 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 24 unverified (of 34 harvested samples) · 34 pointer-only (licence)
-
Beyond English-Only Reading Comprehension: Experiments in Zero-Shot Multilingual Transfer for Bulgarian 5 Aug 2019 · 1 repository · arXiv:1908.01519
-
Exploring Neural Net Augmentation to BERT for Question Answering on SQUAD 2.0 4 Aug 2019 · 0 repositories · arXiv:1908.01767
-
Exploring the Robustness of NMT Systems to Nonsensical Inputs 3 Aug 2019 · 0 repositories · arXiv:1908.01165
-
Universal Transforming Geometric Network 2 Aug 2019 · 1 repository · arXiv:1908.00723
-
Approaching SMM4H with Merged Models and Multi-task Learning 1 Aug 2019 · 0 repositories
-
Baidu Neural Machine Translation Systems for WMT19 1 Aug 2019 · 0 repositories
-
BERT Masked Language Modeling for Co-reference Resolution 1 Aug 2019 · 0 repositories
-
BSC Participation in the WMT Translation of Biomedical Abstracts 1 Aug 2019 · 0 repositories
-
BSNLP2019 Shared Task Submission: Multisource Neural NER Transfer 1 Aug 2019 · 0 repositories
-
Combining Local and Document-Level Context: The LMU Munich Neural Machine Translation System at WMT19 1 Aug 2019 · 0 repositories
-
Cross-Lingual Lemmatization and Morphology Tagging with Two-Stage Multilingual BERT Fine-Tuning 1 Aug 2019 · 1 repository
-
CUED@WMT19:EWC&LMs 1 Aug 2019 · 0 repositories