Methods › General › Regularization › Attention Dropout › Papers, page 109
Attention Dropout
Papers archive 2025-07-28
archive papers tagged: 10,892 · with a code link: 4,634 · where Syntology ran a sample: 1,270 (1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1,270 of 10,892 tagged: 1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument)
Page 109 of 109: papers 10,801 to 10,892 of 10,892, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Adaptive Attention Span in Transformers 19 May 2019 · 8 repositories · arXiv:1905.07799
-
HellaSwag: Can a Machine Really Finish Your Sentence? 19 May 2019 · 2 repositories · arXiv:1905.07830Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 4 pointer-only (licence)
-
BERTSel: Answer Selection with Pre-trained Models 18 May 2019 · 1 repository · arXiv:1905.07588
-
ERNIE: Enhanced Language Representation with Informative Entities 17 May 2019 · 2 repositories · arXiv:1905.07129Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Story Ending Prediction by Transferable BERT 17 May 2019 · 1 repository · arXiv:1905.07504
-
Latent Universal Task-Specific BERT 16 May 2019 · 0 repositories · arXiv:1905.06638
-
A Surprisingly Robust Trick for Winograd Schema Challenge 15 May 2019 · 2 repositories · arXiv:1905.06290
-
BERT Rediscovers the Classical NLP Pipeline 15 May 2019 · 1 repository · arXiv:1905.05950
-
PatentBERT: Patent Classification with Fine-Tuning a pre-trained BERT Model 14 May 2019 · 1 repository · arXiv:1906.02124
-
BERT with History Answer Embedding for Conversational Question Answering 14 May 2019 · 1 repository · arXiv:1905.05412
-
Cognitive Graph for Multi-Hop Reading Comprehension at Scale 14 May 2019 · 2 repositories · arXiv:1905.05460Syntology official (archive's flag): 5 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 2 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
How to Fine-Tune BERT for Text Classification? 14 May 2019 · 15 repositories · arXiv:1905.05583Syntology official (archive's flag): 1 ran · 12 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 18 harvested samples) · 5 pointer-only (licence)
-
Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word Sense Disambiguation 14 May 2019 · 2 repositories · arXiv:1905.05677
-
A logical-based corpus for cross-lingual evaluation 10 May 2019 · 1 repository · arXiv:1905.05704
-
FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance 8 May 2019 · 1 repository · arXiv:1905.02851
-
Unified Language Model Pre-training for Natural Language Understanding and Generation 8 May 2019 · 9 repositories · arXiv:1905.03197
-
Taming Pretrained Transformers for Extreme Multi-label Text Classification 7 May 2019 · 2 repositories · arXiv:1905.02331Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
MASS: Masked Sequence to Sequence Pre-training for Language Generation 7 May 2019 · 7 repositories · arXiv:1905.02450
-
Anonymized BERT: An Augmentation Approach to the Gendered Pronoun Resolution Challenge 6 May 2019 · 1 repository · arXiv:1905.01780
-
Investigating the Successes and Failures of BERT for Passage Re-Ranking 5 May 2019 · 0 repositories · arXiv:1905.01758
-
Unsupervised Data Augmentation for Consistency Training 29 Apr 2019 · 20 repositories · arXiv:1904.12848Syntology official (archive's flag): 10 ran · 30 ran (of which 3 constructed an object rather than computing a result; 22 with no instrument failure: 0 honoured, 0 violated, 22 with no contract checked; 8 where Syntology's instrument failed) · 22 unverified (of 52 harvested samples) · 17 pointer-only (licence)
-
Softmax Optimizations for Intel Xeon Processor-based Platforms 28 Apr 2019 · 0 repositories · arXiv:1904.12380
-
Generating Long Sequences with Sparse Transformers 23 Apr 2019 · 7 repositories · arXiv:1904.10509Syntology community repositories only · 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
Model Compression with Multi-Task Knowledge Distillation for Web-scale Question Answering System 21 Apr 2019 · 0 repositories · arXiv:1904.09636
-
Language Models with Transformers 20 Apr 2019 · 1 repository · arXiv:1904.09408Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
An Evaluation of Transfer Learning for Classifying Sales Engagement Emails at Large Scale 19 Apr 2019 · 0 repositories · arXiv:1905.01971
-
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT 19 Apr 2019 · 2 repositories · arXiv:1904.09077
-
ERNIE: Enhanced Representation through Knowledge Integration 19 Apr 2019 · 19 repositories · arXiv:1904.09223Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Unifying Question Answering, Text Classification, and Regression via Span Extraction 19 Apr 2019 · 0 repositories · arXiv:1904.09286
-
DocBERT: BERT for Document Classification 17 Apr 2019 · 3 repositories · arXiv:1904.08398Syntology official (archive's flag): 6 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples)
-
Understanding the Behaviors of BERT in Ranking 16 Apr 2019 · 0 repositories · arXiv:1904.07531
-
CEDR: Contextualized Embeddings for Document Ranking 15 Apr 2019 · 7 repositories · arXiv:1904.07094Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
Improving Human Text Comprehension through Semi-Markov CRF-based Neural Section Title Generation 15 Apr 2019 · 0 repositories · arXiv:1904.07142
-
Pre-training of Context-aware Item Representation for Next Basket Recommendation 14 Apr 2019 · 0 repositories · arXiv:1904.12604
-
Data Augmentation for BERT Fine-Tuning in Open-Domain Question Answering 14 Apr 2019 · 0 repositories · arXiv:1904.06652
-
Rare Words: A Major Problem for Contextualized Embeddings And How to Fix it by Attentive Mimicking 14 Apr 2019 · 2 repositories · arXiv:1904.06707Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Harvey Mudd College at SemEval-2019 Task 4: The Clint Buchanan Hyperpartisan News Detector 10 Apr 2019 · 1 repository · arXiv:1905.01962
-
NLPR@SRPOL at SemEval-2019 Task 6 and Task 5: Linguistically enhanced deep learning offensive sentence classifier 10 Apr 2019 · 0 repositories · arXiv:1904.05152
-
Simple BERT Models for Relation Extraction and Semantic Role Labeling 10 Apr 2019 · 3 repositories · arXiv:1904.05255Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing 9 Apr 2019 · 1 repository · arXiv:1904.04697
-
Jointly Measuring Diversity and Quality in Text Generation Models 8 Apr 2019 · 3 repositories · arXiv:1904.03971Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
Publicly Available Clinical BERT Embeddings 6 Apr 2019 · 3 repositories · arXiv:1904.03323Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
ThisIsCompetition at SemEval-2019 Task 9: BERT is unstable for out-of-domain samples 6 Apr 2019 · 0 repositories · arXiv:1904.03339
-
UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMs 6 Apr 2019 · 1 repository · arXiv:1904.03450
-
Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling 4 Apr 2019 · 1 repository · arXiv:1904.02817
-
Visualizing Attention in Transformer-Based Language Representation Models 4 Apr 2019 · 0 repositories · arXiv:1904.02679
-
75 Languages, 1 Model: Parsing Universal Dependencies Universally 3 Apr 2019 · 3 repositories · arXiv:1904.02099Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples)
-
BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis 3 Apr 2019 · 1 repository · arXiv:1904.02232Syntology 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
Probing Biomedical Embeddings from Language Models 3 Apr 2019 · 1 repository · arXiv:1904.02181
-
VideoBERT: A Joint Model for Video and Language Representation Learning 3 Apr 2019 · 3 repositories · arXiv:1904.01766Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Large Batch Optimization for Deep Learning: Training BERT in 76 minutes 1 Apr 2019 · 32 repositories · arXiv:1904.00962Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 9 pointer-only (licence)
-
ANA at SemEval-2019 Task 3: Contextual Emotion detection in Conversations through hierarchical LSTMs and BERT 30 Mar 2019 · 1 repository · arXiv:1904.00132
-
Making Neural Machine Reading Comprehension Faster 29 Mar 2019 · 0 repositories · arXiv:1904.00796
-
Distilling Task-Specific Knowledge from BERT into Simple Neural Networks 28 Mar 2019 · 4 repositories · arXiv:1903.12136Syntology 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
SciBERT: A Pretrained Language Model for Scientific Text 26 Mar 2019 · 6 repositories · arXiv:1903.10676
-
Simple Applications of BERT for Ad Hoc Document Retrieval 26 Mar 2019 · 2 repositories · arXiv:1903.10972
-
Fine-tune BERT for Extractive Summarization 25 Mar 2019 · 12 repositories · arXiv:1903.10318Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)
-
On Measuring Social Biases in Sentence Encoders 25 Mar 2019 · 1 repository · arXiv:1903.10561
-
Recognizing Arrow Of Time In The Short Stories 25 Mar 2019 · 1 repository · arXiv:1903.10548
-
Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence 22 Mar 2019 · 8 repositories · arXiv:1903.09588Syntology official (archive's flag): 8 ran · 19 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 3 honoured, 0 violated, 12 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 27 harvested samples) · 9 pointer-only (licence)
-
Cloze-driven Pretraining of Self-attention Networks 19 Mar 2019 · 0 repositories · arXiv:1903.07785
-
HLT@SUDA at SemEval 2019 Task 1: UCCA Graph Parsing as Constituent Tree Parsing 11 Mar 2019 · 0 repositories · arXiv:1903.04153
-
BERT for Joint Intent Classification and Slot Filling 28 Feb 2019 · 16 repositories · arXiv:1902.10909Syntology 26 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 1 honoured, 0 violated, 18 with no contract checked; 7 where Syntology's instrument failed) · 6 unverified (of 32 harvested samples) · 5 pointer-only (licence)
-
Attentional Encoder Network for Targeted Sentiment Classification 25 Feb 2019 · 5 repositories · arXiv:1902.09314
-
Pretraining-Based Natural Language Generation for Text Summarization 25 Feb 2019 · 4 repositories · arXiv:1902.09243Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Enhancing Clinical Concept Extraction with Contextual Embeddings 22 Feb 2019 · 0 repositories · arXiv:1902.08691
-
Language Models are Unsupervised Multitask Learners 14 Feb 2019 · 21 repositories
-
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model 11 Feb 2019 · 13 repositories · arXiv:1902.04094Syntology official (archive's flag): 2 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning 7 Feb 2019 · 2 repositories · arXiv:1902.02671
-
End-to-End Open-Domain Question Answering with BERTserini 5 Feb 2019 · 1 repository · arXiv:1902.01718Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 3 pointer-only (licence)
-
A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization 4 Feb 2019 · 5 repositories · arXiv:1902.01069Syntology official (archive's flag): 3 ran · 21 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 2 violated, 1 with no contract checked; 16 where Syntology's instrument failed) · 15 unverified (of 36 harvested samples) · 33 pointer-only (licence)
-
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference 4 Feb 2019 · 6 repositories · arXiv:1902.01007Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Parameter-Efficient Transfer Learning for NLP 2 Feb 2019 · 17 repositories · arXiv:1902.00751Syntology official: harvested, nothing ran · 14 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 22 harvested samples) · 3 pointer-only (licence)
-
Multi-Task Deep Neural Networks for Natural Language Understanding 31 Jan 2019 · 7 repositories · arXiv:1901.11504Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 4 pointer-only (licence)
-
BioBERT: a pre-trained biomedical language representation model for biomedical text mining 25 Jan 2019 · 19 repositories · arXiv:1901.08746Syntology official: no sample here; runs from other or unrecorded repositories · 15 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 10 unverified (of 25 harvested samples) · 3 pointer-only (licence)
-
A BERT Baseline for the Natural Questions 24 Jan 2019 · 3 repositories · arXiv:1901.08634Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
-
Self-Attentive Model for Headline Generation 23 Jan 2019 · 0 repositories · arXiv:1901.07786
-
Cross-lingual Language Model Pretraining 22 Jan 2019 · 17 repositories · arXiv:1901.07291Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
Assessing BERT's Syntactic Abilities 16 Jan 2019 · 3 repositories · arXiv:1901.05287Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Passage Re-ranking with BERT 13 Jan 2019 · 6 repositories · arXiv:1901.04085Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 2 pointer-only (licence)
-
Linguistic Analysis of Pretrained Sentence Encoders with Acceptability Judgments 11 Jan 2019 · 0 repositories · arXiv:1901.03438
-
Multilingual Constituency Parsing with Self-Attention and Pre-Training 31 Dec 2018 · 4 repositories · arXiv:1812.11760Syntology official (archive's flag): 8 ran · 22 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 0 honoured, 0 violated, 19 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 28 harvested samples) · 3 pointer-only (licence)
-
Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling 28 Dec 2018 · 0 repositories · arXiv:1812.10860
-
Conditional BERT Contextual Augmentation 17 Dec 2018 · 5 repositories · arXiv:1812.06705Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering 10 Dec 2018 · 6 repositories · arXiv:1812.03593
-
Attending to Mathematical Language with Transformers 5 Dec 2018 · 3 repositories · arXiv:1812.02825
-
Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Tasks 2 Nov 2018 · 1 repository · arXiv:1811.01088
-
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 11 Oct 2018 · 534 repositories · arXiv:1810.04805Syntology official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 235 with no instrument failure: 17 honoured, 4 violated, 214 with no contract checked; 65 where Syntology's instrument failed) · 359 unverified (of 659 harvested samples) · 164 pointer-only (licence)
-
Weakly Supervised Bilinear Attention Network for Fine-Grained Visual Classification 6 Aug 2018 · 0 repositories · arXiv:1808.02152
-
Universal Transformers 10 Jul 2018 · 8 repositories · arXiv:1807.03819Syntology community repositories only · 17 ran (of which 8 constructed an object rather than computing a result; 17 with no instrument failure: 1 honoured, 0 violated, 16 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 25 harvested samples) · 24 pointer-only (licence)
-
Improving Language Understanding by Generative Pre-Training 11 Jun 2018 · 13 repositories
-
An Improved Image Mosaicing Algorithm for Damaged Documents 7 Mar 2015 · 0 repositories · arXiv:1503.02136