Methods › General › Regularization › Attention Dropout › Papers, page 104
Attention Dropout
Papers archive 2025-07-28
archive papers tagged: 10,892 · with a code link: 4,634 · where Syntology ran a sample: 1,270 (1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1,270 of 10,892 tagged: 1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument)
Page 104 of 109: papers 10,301 to 10,400 of 10,892, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Why are Adaptive Methods Good for Attention Models? 6 Dec 2019 · 0 repositories · arXiv:1912.03194
-
Self-Supervised Contextual Language Representation of Radiology Reports to Improve the Identification of Communication Urgency 5 Dec 2019 · 0 repositories · arXiv:1912.02703
-
Acquiring Knowledge from Pre-trained Model to Neural Machine Translation 4 Dec 2019 · 0 repositories · arXiv:1912.01774
-
Enhancing Relation Extraction Using Syntactic Indicators and Sentential Contexts 4 Dec 2019 · 1 repository · arXiv:1912.01858
-
A Comparative Study of Pretrained Language Models on Thai Social Text Categorization 3 Dec 2019 · 0 repositories · arXiv:1912.01580
-
BERT for Large-scale Video Segment Classification with Test-time Augmentation 2 Dec 2019 · 0 repositories · arXiv:1912.01127
-
Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shift 2 Dec 2019 · 0 repositories · arXiv:1912.01072
-
Fast and Accurate Stochastic Gradient Estimation 1 Dec 2019 · 1 repository
-
Inducing Relational Knowledge from BERT 28 Nov 2019 · 0 repositories · arXiv:1911.12753
-
Do Attention Heads in BERT Track Syntactic Dependencies? 27 Nov 2019 · 1 repository · arXiv:1911.12246
-
Evaluating Commonsense in Pre-trained Language Models 27 Nov 2019 · 1 repository · arXiv:1911.11931
-
Taking a Stance on Fake News: Towards Automatic Disinformation Assessment via Deep Bidirectional Transformer Language Models for Stance Detection 27 Nov 2019 · 0 repositories · arXiv:1911.11951
-
Low Rank Factorization for Compact Multi-Head Self-Attention 26 Nov 2019 · 1 repository · arXiv:1912.00835
-
Who did They Respond to? Conversation Structure Modeling using Masked Hierarchical Transformer 25 Nov 2019 · 1 repository · arXiv:1911.10666
-
Automatically Neutralizing Subjective Bias in Text 21 Nov 2019 · 1 repository · arXiv:1911.09709Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 13 harvested samples)
-
Chemical-protein Interaction Extraction via Gaussian Probability Distribution and External Biomedical Knowledge 21 Nov 2019 · 1 repository · arXiv:1911.09487
-
Paraphrasing with Large Language Models 21 Nov 2019 · 0 repositories · arXiv:1911.09661
-
Joint Emotion Label Space Modelling for Affect Lexica 20 Nov 2019 · 0 repositories · arXiv:1911.08782
-
Towards Lingua Franca Named Entity Recognition with BERT 19 Nov 2019 · 0 repositories · arXiv:1912.01389
-
Towards non-toxic landscapes: Automatic toxic comment detection using DNN 19 Nov 2019 · 0 repositories · arXiv:1911.08395
-
Unsupervised Natural Question Answering with a Small Model 19 Nov 2019 · 0 repositories · arXiv:1911.08340
-
Improving Relation Classification by Entity Pair Graph 17 Nov 2019 · 0 repositories
-
Unsupervised Visual Representation Learning with Increasing Object Shape Bias 17 Nov 2019 · 0 repositories · arXiv:1911.07272
-
Robust Reading Comprehension with Linguistic Constraints via Posterior Regularization 16 Nov 2019 · 0 repositories · arXiv:1911.06948
-
Evaluating robustness of language models for chief complaint extraction from patient-generated text 15 Nov 2019 · 0 repositories · arXiv:1911.06915
-
Adapting and evaluating a deep learning language model for clinical why-question answering 13 Nov 2019 · 0 repositories · arXiv:1911.05604
-
Unsupervised Domain Adaptation on Reading Comprehension 13 Nov 2019 · 1 repository · arXiv:1911.06137
-
What do you mean, BERT? Assessing BERT as a Distributional Semantics Model 13 Nov 2019 · 0 repositories · arXiv:1911.05758
-
A Syntax-aware Multi-task Learning Framework for Chinese Semantic Role Labeling 12 Nov 2019 · 1 repository · arXiv:1911.04641
-
Attending to Entities for Better Text Understanding 11 Nov 2019 · 0 repositories · arXiv:1911.04361
-
Meta Answering for Machine Reading 11 Nov 2019 · 0 repositories · arXiv:1911.04156
-
NegBERT: A Transfer Learning Approach for Negation Detection and Scope Resolution 11 Nov 2019 · 1 repository · arXiv:1911.04211
-
Understanding BERT performance in propaganda analysis 11 Nov 2019 · 0 repositories · arXiv:1911.04525
-
Distilling Knowledge Learned in BERT for Text Generation 10 Nov 2019 · 2 repositories · arXiv:1911.03829Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Effectiveness of self-supervised pre-training for speech recognition 10 Nov 2019 · 2 repositories · arXiv:1911.03912
-
Improving BERT Fine-tuning with Embedding Normalization 10 Nov 2019 · 0 repositories · arXiv:1911.03918
-
Improving Transformer Models by Reordering their Sublayers 10 Nov 2019 · 2 repositories · arXiv:1911.03864
-
INSET: Sentence Infilling with INter-SEntential Transformer 10 Nov 2019 · 1 repository · arXiv:1911.03892
-
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers 10 Nov 2019 · 4 repositories · arXiv:1911.04942Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 4 pointer-only (licence)
-
Increasing Robustness to Spurious Correlations using Forgettable Examples 10 Nov 2019 · 0 repositories · arXiv:1911.03861
-
Syntax-Infused Transformer and BERT models for Machine Translation and Natural Language Understanding 10 Nov 2019 · 0 repositories · arXiv:1911.06156
-
Contextualized End-to-End Neural Entity Linking 10 Nov 2019 · 0 repositories · arXiv:1911.03834
-
Scalable Zero-shot Entity Linking with Dense Entity Retrieval 10 Nov 2019 · 3 repositories · arXiv:1911.03814
-
MKD: a Multi-Task Knowledge Distillation Approach for Pretrained Language Models 9 Nov 2019 · 0 repositories · arXiv:1911.03588
-
E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT 9 Nov 2019 · 1 repository · arXiv:1911.03681
-
ConveRT: Efficient and Accurate Conversational Representations from Transformers 9 Nov 2019 · 5 repositories · arXiv:1911.03688Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
-
Multi-Perspective Inferrer: Reasoning Sentences Relationship from Holistic Perspective 9 Nov 2019 · 0 repositories · arXiv:1911.03668
-
The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents 9 Nov 2019 · 0 repositories · arXiv:1911.03768
-
Zero-Shot Paraphrase Generation with Multilingual Language Models 9 Nov 2019 · 0 repositories · arXiv:1911.03597
-
Cross-Lingual Relevance Transfer for Document Retrieval 8 Nov 2019 · 0 repositories · arXiv:1911.02989
-
Graph-to-Graph Transformer for Transition-based Dependency Parsing 8 Nov 2019 · 1 repository · arXiv:1911.03561
-
How Language-Neutral is Multilingual BERT? 8 Nov 2019 · 1 repository · arXiv:1911.03310
-
Pretrained Language Models for Document-Level Neural Machine Translation 8 Nov 2019 · 0 repositories · arXiv:1911.03110
-
Resurrecting Submodularity for Neural Text Generation 8 Nov 2019 · 0 repositories · arXiv:1911.03014
-
SEPT: Improving Scientific Named Entity Recognition with Span Representation 8 Nov 2019 · 0 repositories · arXiv:1911.03353
-
Towards Hierarchical Importance Attribution: Explaining Compositional Semantics for Neural Sequence Models 8 Nov 2019 · 3 repositories · arXiv:1911.06194
-
Transforming Wikipedia into Augmented Data for Query-Focused Summarization 8 Nov 2019 · 0 repositories · arXiv:1911.03324
-
What Would Elsa Do? Freezing Layers During Transformer Fine-Tuning 8 Nov 2019 · 0 repositories · arXiv:1911.03090
-
BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance 7 Nov 2019 · 1 repository · arXiv:1911.02969
-
Blockwise Self-Attention for Long Document Understanding 7 Nov 2019 · 1 repository · arXiv:1911.02972
-
Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs 7 Nov 2019 · 2 repositories · arXiv:1911.02707Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Explicit Pairwise Word Interaction Modeling Improves Pretrained Transformers for English Semantic Similarity Tasks 7 Nov 2019 · 0 repositories · arXiv:1911.02847
-
The LIG system for the English-Czech Text Translation Task of IWSLT 2019 7 Nov 2019 · 0 repositories · arXiv:1911.02898
-
How Can BERT Help Lexical Semantics Tasks? 7 Nov 2019 · 0 repositories · arXiv:1911.02929
-
Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds 6 Nov 2019 · 0 repositories · arXiv:1911.02365
-
Unsupervised Domain Adaptation of Contextual Embeddings for Low-Resource Duplicate Question Detection 6 Nov 2019 · 0 repositories · arXiv:1911.02645
-
Deepening Hidden Representations from Pre-trained Language Models 5 Nov 2019 · 0 repositories · arXiv:1911.01940
-
Improving Slot Filling by Utilizing Contextual Information 5 Nov 2019 · 0 repositories · arXiv:1911.01680
-
Incremental Sense Weight Training for the Interpretation of Contextualized Word Embeddings 5 Nov 2019 · 0 repositories · arXiv:1911.01623
-
MML: Maximal Multiverse Learning for Robust Fine-Tuning of Language Models 5 Nov 2019 · 1 repository · arXiv:1911.06182
-
Unsupervised Cross-lingual Representation Learning at Scale 5 Nov 2019 · 35 repositories · arXiv:1911.02116Syntology official (archive's flag): 12 ran · 40 ran (of which 13 constructed an object rather than computing a result; 35 with no instrument failure: 4 honoured, 1 violated, 30 with no contract checked; 5 where Syntology's instrument failed) · 19 unverified (of 59 harvested samples) · 52 pointer-only (licence)
-
Assessing Social and Intersectional Biases in Contextualized Word Representations 4 Nov 2019 · 1 repository · arXiv:1911.01485
-
BAS: An Answer Selection Method Using BERT Language Model 4 Nov 2019 · 0 repositories · arXiv:1911.01528
-
Sentence-Level BERT and Multi-Task Learning of Age and Gender in Social Media 2 Nov 2019 · 0 repositories · arXiv:1911.00637
-
A Deep Learning-Based System for PharmaCoNER 1 Nov 2019 · 0 repositories
-
A Multi-Task Learning Framework for Extracting Bacteria Biotope Information 1 Nov 2019 · 0 repositories
-
A Recurrent BERT-based Model for Question Generation 1 Nov 2019 · 1 repository
-
Aggregating Bidirectional Encoder Representations Using MatchLSTM for Sequence Matching 1 Nov 2019 · 0 repositories
-
Applying BERT to Document Retrieval with Birch 1 Nov 2019 · 0 repositories
-
BERT Goes to Law School: Quantifying the Competitive Advantage of Access to Large Legal Corpora in Contract Understanding 1 Nov 2019 · 0 repositories · arXiv:1911.00473
-
BERT is Not an Interlingua and the Bias of Tokenization 1 Nov 2019 · 1 repository
-
Biomedical Named Entity Recognition with Multilingual BERT 1 Nov 2019 · 1 repository
-
BLCU-NLP at COIN-Shared Task1: Stagewise Fine-tuning BERT for Commonsense Inference in Everyday Narrations 1 Nov 2019 · 0 repositories
-
CAUnLP at NLP4IF 2019 Shared Task: Context-Dependent BERT for Sentence-Level Propaganda Detection 1 Nov 2019 · 0 repositories
-
CLER: Cross-task Learning with Expert Representation to Generalize Reading and Understanding 1 Nov 2019 · 0 repositories
-
Combining Unsupervised Pre-training and Annotator Rationales to Improve Low-shot Text Classification 1 Nov 2019 · 0 repositories
-
Contextualized Cross-Lingual Event Trigger Extraction with Minimal Resources 1 Nov 2019 · 0 repositories
-
Cost-Sensitive BERT for Generalisable Sentence Classification on Imbalanced Data 1 Nov 2019 · 0 repositories
-
Cross-Domain Modeling of Sentence-Level Evidence for Document Retrieval 1 Nov 2019 · 0 repositories
-
Deep Bidirectional Transformers for Relation Extraction without Supervision 1 Nov 2019 · 0 repositories · arXiv:1911.00313
-
Detection of Propaganda Using Logistic Regression 1 Nov 2019 · 0 repositories
-
Divisive Language and Propaganda Detection using Multi-head Attention Transformers with Deep Learning BERT-based Language Models for Binary Classification 1 Nov 2019 · 0 repositories
-
Domain Adaptation with BERT-based Domain Classification and Data Selection 1 Nov 2019 · 0 repositories
-
Enhancing BERT for Lexical Normalization 1 Nov 2019 · 0 repositories
-
Evaluating BERT for natural language inference: A case study on the CommitmentBank 1 Nov 2019 · 0 repositories
-
Event Causality Recognition Exploiting Multiple Annotators' Judgments and Background Knowledge 1 Nov 2019 · 0 repositories
-
Extract and Aggregate: A Novel Domain-Independent Approach to Factual Data Verification 1 Nov 2019 · 0 repositories
-
Extractive NarrativeQA with Heuristic Pre-Training 1 Nov 2019 · 0 repositories
-
FASPell: A Fast, Adaptable, Simple, Powerful Chinese Spell Checker Based On DAE-Decoder Paradigm 1 Nov 2019 · 1 repository
-
Fine-Grained Propaganda Detection with Fine-Tuned BERT 1 Nov 2019 · 0 repositories