Methods › General › Regularization › Attention Dropout › Papers, page 68
Attention Dropout
Papers archive 2025-07-28
archive papers tagged: 10,892 · with a code link: 4,634 · where Syntology ran a sample: 1,270 (1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1,270 of 10,892 tagged: 1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument)
Page 68 of 109: papers 6,701 to 6,800 of 10,892, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Urdu News Article Recommendation Model using Natural Language Processing Techniques 29 May 2022 · 0 repositories · arXiv:2206.11862
-
Teaching Models to Express Their Uncertainty in Words 28 May 2022 · 1 repository · arXiv:2205.14334Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness 27 May 2022 · 13 repositories · arXiv:2205.14135Syntology official: no sample here; runs from other or unrecorded repositories · 24 ran (of which 2 constructed an object rather than computing a result; 18 with no instrument failure: 0 honoured, 1 violated, 17 with no contract checked; 6 where Syntology's instrument failed) · 6 unverified (of 30 harvested samples) · 1 pointer-only (licence)
-
Multimodal Masked Autoencoders Learn Transferable Representations 27 May 2022 · 3 repositories · arXiv:2205.14204Syntology official (archive's flag): 3 ran · 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples)
-
kNN-Prompt: Nearest Neighbor Zero-Shot Inference 27 May 2022 · 1 repository · arXiv:2205.13792
-
What Dense Graph Do You Need for Self-Attention? 27 May 2022 · 1 repository · arXiv:2205.14014
-
Federated Split BERT for Heterogeneous Text Classification 26 May 2022 · 0 repositories · arXiv:2205.13299
-
Learning Dialogue Representations from Consecutive Utterances 26 May 2022 · 1 repository · arXiv:2205.13568
-
Leveraging Dependency Grammar for Fine-Grained Offensive Language Detection using Graph Convolutional Networks 26 May 2022 · 1 repository · arXiv:2205.13164
-
The Document Vectors Using Cosine Similarity Revisited 26 May 2022 · 1 repository · arXiv:2205.13357
-
Training and Inference on Any-Order Autoregressive Models the Right Way 26 May 2022 · 1 repository · arXiv:2205.13554
-
BiT: Robustly Binarized Multi-distilled Transformer 25 May 2022 · 3 repositories · arXiv:2205.13016Syntology official (archive's flag): 2 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Conditional set generation using Seq2seq models 25 May 2022 · 0 repositories · arXiv:2205.12485
-
Large Language Models are Few-Shot Clinical Information Extractors 25 May 2022 · 0 repositories · arXiv:2205.12689
-
Lifelong Learning Natural Language Processing Approach for Multilingual Data Classification 25 May 2022 · 0 repositories · arXiv:2206.11867
-
NaturalProver: Grounded Mathematical Proof Generation with Language Models 25 May 2022 · 1 repository · arXiv:2205.12910Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data 25 May 2022 · 0 repositories · arXiv:2205.12600
-
RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning 25 May 2022 · 1 repository · arXiv:2205.12598Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data 25 May 2022 · 1 repository · arXiv:2205.12682
-
Text-to-Face Generation with StyleGAN2 25 May 2022 · 0 repositories · arXiv:2205.12512
-
Do we need Label Regularization to Fine-tune Pre-trained Language Models? 25 May 2022 · 0 repositories · arXiv:2205.12428
-
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models 25 May 2022 · 0 repositories · arXiv:2205.12694
-
Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling 25 May 2022 · 1 repository · arXiv:2205.12986Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection 25 May 2022 · 1 repository · arXiv:2205.12424
-
EdiT5: Semi-Autoregressive Text-Editing with T5 Warm-Start 24 May 2022 · 0 repositories · arXiv:2205.12209
-
FLUTE: Figurative Language Understanding through Textual Explanations 24 May 2022 · 1 repository · arXiv:2205.12404
-
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition 24 May 2022 · 1 repository · arXiv:2205.11799
-
Garden-Path Traversal in GPT-2 24 May 2022 · 1 repository · arXiv:2205.12302Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models 24 May 2022 · 1 repository · arXiv:2205.12247
-
The Authenticity Gap in Human Evaluation 24 May 2022 · 0 repositories · arXiv:2205.11930
-
K-12BERT: BERT for K-12 education 24 May 2022 · 1 repository · arXiv:2205.12335
-
Medical Scientific Table-to-Text Generation with Human-in-the-Loop under the Data Sparsity Constraint 24 May 2022 · 0 repositories · arXiv:2205.12368
-
On the Role of Bidirectionality in Language Model Pre-Training 24 May 2022 · 0 repositories · arXiv:2205.11726
-
Partial-input baselines show that NLI models can ignore context, but they don't 24 May 2022 · 1 repository · arXiv:2205.12181
-
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder 24 May 2022 · 1 repository · arXiv:2205.12035
-
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT 24 May 2022 · 1 repository · arXiv:2205.12399
-
Word-order typology in Multilingual BERT: A case study in subordinate-clause detection 24 May 2022 · 0 repositories · arXiv:2205.11987
-
Workflow Discovery from Dialogues in the Low Data Regime 24 May 2022 · 1 repository · arXiv:2205.11690
-
A Question-Answer Driven Approach to Reveal Affirmative Interpretations from Verbal Negations 23 May 2022 · 1 repository · arXiv:2205.11467
-
Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita 23 May 2022 · 1 repository · arXiv:2205.11020
-
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla 23 May 2022 · 2 repositories · arXiv:2205.11081
-
Improving Short Text Classification With Augmented Data Using GPT-3 23 May 2022 · 0 repositories · arXiv:2205.10981
-
KOLD: Korean Offensive Language Dataset 23 May 2022 · 1 repository · arXiv:2205.11315
-
Learning to Ignore Adversarial Attacks 23 May 2022 · 0 repositories · arXiv:2205.11551
-
Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements 23 May 2022 · 1 repository · arXiv:2205.11374
-
On the Paradox of Learning to Reason from Data 23 May 2022 · 1 repository · arXiv:2205.11502Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
Outliers Dimensions that Disrupt Transformers Are Driven by Frequency 23 May 2022 · 1 repository · arXiv:2205.11380Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 16 harvested samples)
-
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning 23 May 2022 · 2 repositories · arXiv:2205.11005Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions 23 May 2022 · 0 repositories · arXiv:2205.11658
-
Prompt Tuning for Discriminative Pre-trained Language Models 23 May 2022 · 1 repository · arXiv:2205.11166Syntology official (archive's flag): 7 ran · 7 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples)
-
RL with KL penalties is better viewed as Bayesian inference 23 May 2022 · 0 repositories · arXiv:2205.11275
-
The Diminishing Returns of Masked Language Models to Science 23 May 2022 · 0 repositories · arXiv:2205.11342
-
Simple Recurrence Improves Masked Language Models 23 May 2022 · 0 repositories · arXiv:2205.11588
-
A Graph Enhanced BERT Model for Event Prediction 22 May 2022 · 0 repositories · arXiv:2205.10822
-
GraphMAE: Self-Supervised Masked Graph Autoencoders 22 May 2022 · 3 repositories · arXiv:2205.10803Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Instruction Induction: From Few Examples to Natural Language Task Descriptions 22 May 2022 · 1 repository · arXiv:2205.10782Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
A Study on Transformer Configuration and Training Objective 21 May 2022 · 0 repositories · arXiv:2205.10505
-
Least-to-Most Prompting Enables Complex Reasoning in Large Language Models 21 May 2022 · 1 repository · arXiv:2205.10625
-
Life after BERT: What do Other Muppets Understand about Language? 21 May 2022 · 1 repository · arXiv:2205.10696
-
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese 21 May 2022 · 1 repository · arXiv:2205.10517
-
Current Trends and Approaches in Synonyms Extraction: Potential Adaptation to Arabic 20 May 2022 · 0 repositories · arXiv:2205.10412
-
Exploring Extreme Parameter Compression for Pre-trained Language Models 20 May 2022 · 1 repository · arXiv:2205.10036
-
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection 20 May 2022 · 0 repositories · arXiv:2205.10455
-
Progressive Class Semantic Matching for Semi-supervised Text Classification 20 May 2022 · 1 repository · arXiv:2205.10189
-
Prototypical Calibration for Few-shot Learning of Language Models 20 May 2022 · 1 repository · arXiv:2205.10183
-
ArabGlossBERT: Fine-Tuning BERT on Context-Gloss Pairs for WSD 19 May 2022 · 0 repositories · arXiv:2205.09685
-
Automated Scoring for Reading Comprehension via In-context BERT Tuning 19 May 2022 · 1 repository · arXiv:2205.09864
-
Overcoming Language Disparity in Online Content Classification with Multimodal Learning 19 May 2022 · 1 repository · arXiv:2205.09744
-
Psychiatric Scale Guided Risky Post Screening for Early Detection of Depression 19 May 2022 · 1 repository · arXiv:2205.09497
-
Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation 19 May 2022 · 1 repository · arXiv:2205.09830
-
Evaluation of Transfer Learning for Polish with a Text-to-Text Model 18 May 2022 · 0 repositories · arXiv:2205.08808
-
Learning Rate Curriculum 18 May 2022 · 1 repository · arXiv:2205.09180
-
PASH at TREC 2021 Deep Learning Track: Generative Enhanced Model for Multi-stage Ranking 18 May 2022 · 0 repositories · arXiv:2205.11245
-
Persian Natural Language Inference: A Meta-learning approach 18 May 2022 · 1 repository · arXiv:2205.08755
-
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT 17 May 2022 · 0 repositories · arXiv:2205.08497
-
M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systems 17 May 2022 · 0 repositories · arXiv:2205.08084
-
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation 17 May 2022 · 0 repositories · arXiv:2205.08180
-
SEMI-FND: Stacked Ensemble Based Multimodal Inference For Faster Fake News Detection 17 May 2022 · 0 repositories · arXiv:2205.08159
-
SKILL: Structured Knowledge Infusion for Large Language Models 17 May 2022 · 0 repositories · arXiv:2205.08184
-
ViralBERT: A User Focused BERT-Based Approach to Virality Prediction 17 May 2022 · 1 repository · arXiv:2206.10298
-
Chemical transformer compression for accelerating both training and inference of molecular modeling 16 May 2022 · 1 repository · arXiv:2205.07582
-
Harnessing Multilingual Resources to Question Answering in Arabic 16 May 2022 · 0 repositories · arXiv:2205.08024
-
Heroes, Villains, and Victims, and GPT-3: Automated Extraction of Character Roles Without Training Data 16 May 2022 · 0 repositories · arXiv:2205.07557
-
The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues 16 May 2022 · 1 repository · arXiv:2205.07540
-
What GPT Knows About Who is Who 16 May 2022 · 1 repository · arXiv:2205.07407
-
Discovering Latent Concepts Learned in BERT 15 May 2022 · 0 repositories · arXiv:2205.07237
-
Downstream Transformer Generation of Question-Answer Pairs with Preprocessing and Postprocessing Pipelines 15 May 2022 · 1 repository · arXiv:2205.07387
-
Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT 15 May 2022 · 1 repository · arXiv:2205.07180
-
Fake News Quick Detection on Dynamic Heterogeneous Information Networks 14 May 2022 · 0 repositories · arXiv:2205.07039
-
Naturalistic Causal Probing for Morpho-Syntax 14 May 2022 · 1 repository · arXiv:2205.07043
-
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL 14 May 2022 · 1 repository · arXiv:2205.06983Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
A Study of the Attention Abnormality in Trojaned BERTs 13 May 2022 · 1 repository · arXiv:2205.08305Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Improving Contextual Representation with Gloss Regularized Pre-training 13 May 2022 · 0 repositories · arXiv:2205.06603
-
AppTek's Submission to the IWSLT 2022 Isometric Spoken Language Translation Task 12 May 2022 · 0 repositories · arXiv:2205.05807
-
Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models? 12 May 2022 · 0 repositories · arXiv:2205.06149
-
NER-MQMRC: Formulating Named Entity Recognition as Multi Question Machine Reading Comprehension 12 May 2022 · 0 repositories · arXiv:2205.05904
-
A time-varying study of Chinese investor sentiment, stock market liquidity and volatility: Based on deep learning BERT model and TVP-VAR model 11 May 2022 · 0 repositories · arXiv:2205.05719
-
Clinical Prompt Learning with Frozen Language Models 11 May 2022 · 1 repository · arXiv:2205.05535
-
Query-Based Keyphrase Extraction from Long Documents 11 May 2022 · 1 repository · arXiv:2205.05391
-
Towards the Generation of Musical Explanations with GPT-3 11 May 2022 · 1 repository · arXiv:2206.08264