Methods › General › Regularization › Attention Dropout › Papers, page 64
Attention Dropout
Papers archive 2025-07-28
archive papers tagged: 10,892 · with a code link: 4,634 · where Syntology ran a sample: 1,270 (1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1,270 of 10,892 tagged: 1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument)
Page 64 of 109: papers 6,301 to 6,400 of 10,892, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters 18 Oct 2022 · 0 repositories · arXiv:2211.01979
-
A Generative User Simulator with GPT-based Architecture and Goal State Tracking for Reinforced Multi-Domain Dialog Systems 17 Oct 2022 · 1 repository · arXiv:2210.08692Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
-
CAN-BERT do it? Controller Area Network Intrusion Detection System based on BERT Language Model 17 Oct 2022 · 0 repositories · arXiv:2210.09439
-
iDNA-ABF: multi-scale deep biological language learning model for the interpretable prediction of DNA methylations 17 Oct 2022 · 2 repositories
-
Multi-granularity Argument Mining in Legal Texts 17 Oct 2022 · 0 repositories · arXiv:2210.09472
-
Prompting GPT-3 To Be Reliable 17 Oct 2022 · 1 repository · arXiv:2210.09150
-
Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraints 17 Oct 2022 · 1 repository · arXiv:2210.09440
-
Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time 17 Oct 2022 · 0 repositories · arXiv:2210.09179
-
Acoustic-aware Non-autoregressive Spell Correction with Mask Sample Decoding 16 Oct 2022 · 0 repositories · arXiv:2210.08665
-
CTCBERT: Advancing Hidden-unit BERT with CTC Objectives 16 Oct 2022 · 0 repositories · arXiv:2210.08603
-
Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion 16 Oct 2022 · 0 repositories · arXiv:2210.08471
-
NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly 16 Oct 2022 · 1 repository · arXiv:2210.08604
-
AraLegal-BERT: A pretrained language model for Arabic Legal text 15 Oct 2022 · 0 repositories · arXiv:2210.08284
-
DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation 14 Oct 2022 · 2 repositories · arXiv:2210.07558Syntology official: not harvested · 0 ran · 1 unverified (of 1 harvested sample)
-
Extracting Cultural Commonsense Knowledge at Scale 14 Oct 2022 · 2 repositories · arXiv:2210.07763
-
"John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility 14 Oct 2022 · 1 repository · arXiv:2210.07471
-
Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding 14 Oct 2022 · 2 repositories · arXiv:2210.07547
-
CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision Models 14 Oct 2022 · 0 repositories · arXiv:2210.09223
-
Self-Repetition in Abstractive Neural Summarizers 14 Oct 2022 · 0 repositories · arXiv:2210.08145
-
TestAug: A Framework for Augmenting Capability-based NLP Tests 14 Oct 2022 · 1 repository · arXiv:2210.08097
-
Saliency Map Verbalization: Comparing Feature Importance Representations from Model-free and Instruction-based Methods 13 Oct 2022 · 1 repository · arXiv:2210.07222
-
Explanations from Large Language Models Make Small Reasoners Better 13 Oct 2022 · 0 repositories · arXiv:2210.06726
-
Jointly Reinforced User Simulator and Task-oriented Dialog System with Simplified Generative Architecture 13 Oct 2022 · 0 repositories · arXiv:2210.06706
-
Language Models of Code are Few-Shot Commonsense Learners 13 Oct 2022 · 2 repositories · arXiv:2210.07128Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Large Language Models are few(1)-shot Table Reasoners 13 Oct 2022 · 1 repository · arXiv:2210.06710
-
Overlooked Video Classification in Weakly Supervised Video Anomaly Detection 13 Oct 2022 · 1 repository · arXiv:2210.06688
-
Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformer 13 Oct 2022 · 1 repository · arXiv:2210.06707
-
SQuAT: Sharpness- and Quantization-Aware Training for BERT 13 Oct 2022 · 0 repositories · arXiv:2210.07171
-
Tone prediction and orthographic conversion for Basaa 13 Oct 2022 · 0 repositories · arXiv:2210.06986
-
Are Sample-Efficient NLP Models More Robust? 12 Oct 2022 · 0 repositories · arXiv:2210.06456
-
Foundation Transformers 12 Oct 2022 · 4 repositories · arXiv:2210.06423Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Entity Tracking via Effective Use of Multi-Task Learning Model and Mention-guided Decoding 12 Oct 2022 · 2 repositories · arXiv:2210.06444Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
GMP*: Well-Tuned Gradual Magnitude Pruning Can Outperform Most BERT-Pruning Methods 12 Oct 2022 · 0 repositories · arXiv:2210.06384
-
Instruction Tuning for Few-Shot Aspect-Based Sentiment Analysis 12 Oct 2022 · 1 repository · arXiv:2210.06629
-
On Text Style Transfer via Style Masked Language Models 12 Oct 2022 · 0 repositories · arXiv:2210.06394
-
Predictive Querying for Autoregressive Neural Sequence Models 12 Oct 2022 · 1 repository · arXiv:2210.06464Syntology official (archive's flag): 7 ran · 7 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples)
-
Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary 12 Oct 2022 · 1 repository · arXiv:2210.06376
-
RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses 12 Oct 2022 · 0 repositories · arXiv:2210.10634
-
SUMBot: Summarizing Context in Open-Domain Dialogue Systems 12 Oct 2022 · 0 repositories · arXiv:2210.06496
-
A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models 11 Oct 2022 · 1 repository · arXiv:2210.05211Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification 11 Oct 2022 · 0 repositories · arXiv:2210.05529
-
Are Pretrained Multilingual Models Equally Fair Across Languages? 11 Oct 2022 · 1 repository · arXiv:2210.05457
-
CLIP also Understands Text: Prompting CLIP for Phrase Understanding 11 Oct 2022 · 0 repositories · arXiv:2210.05836
-
Multilingual BERT has an accent: Evaluating English influences on fluency in multilingual models 11 Oct 2022 · 0 repositories · arXiv:2210.05619
-
On the Interpolation of Contextualized Term-based Ranking with BM25 for Query-by-Example Retrieval 11 Oct 2022 · 1 repository · arXiv:2210.05512
-
On the Use of Semantically-Aligned Speech Representations for Spoken Language Understanding 11 Oct 2022 · 0 repositories · arXiv:2210.05291
-
Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems 11 Oct 2022 · 0 repositories · arXiv:2210.05075
-
T5 for Hate Speech, Augmented Data and Ensemble 11 Oct 2022 · 1 repository · arXiv:2210.05480
-
Vote'n'Rank: Revision of Benchmarking with Social Choice Theory 11 Oct 2022 · 1 repository · arXiv:2210.05769Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified (of 17 harvested samples)
-
DEPTWEET: A Typology for Social Media Texts to Detect Depression Severities 10 Oct 2022 · 1 repository · arXiv:2210.05372
-
Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter 10 Oct 2022 · 1 repository · arXiv:2210.04710
-
Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling 10 Oct 2022 · 1 repository · arXiv:2210.05043
-
REV: Information-Theoretic Evaluation of Free-Text Rationales 10 Oct 2022 · 1 repository · arXiv:2210.04982Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
The Minimum Wage as an Anchor: Effects on Determinations of Fairness by Humans and AI 10 Oct 2022 · 0 repositories · arXiv:2210.10585
-
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis 10 Oct 2022 · 1 repository · arXiv:2210.04714Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language Models 9 Oct 2022 · 1 repository · arXiv:2210.04325
-
CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation Models 9 Oct 2022 · 1 repository · arXiv:2210.04191
-
Controllable Dialogue Simulation with In-Context Learning 9 Oct 2022 · 1 repository · arXiv:2210.04185
-
Fine-Grained Detection of Solidarity for Women and Migrants in 155 Years of German Parliamentary Debates 9 Oct 2022 · 2 repositories · arXiv:2210.04359
-
Fine-Tuning Pre-trained Transformers into Decaying Fast Weights 9 Oct 2022 · 1 repository · arXiv:2210.04243Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Better Pre-Training by Reducing Representation Confusion 9 Oct 2022 · 0 repositories · arXiv:2210.04246
-
Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection 9 Oct 2022 · 1 repository · arXiv:2210.04267
-
AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models 8 Oct 2022 · 0 repositories · arXiv:2210.03858
-
KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classification 8 Oct 2022 · 0 repositories · arXiv:2210.03970
-
On Task-Adaptive Pretraining for Dialogue Response Selection 8 Oct 2022 · 0 repositories · arXiv:2210.04073
-
Automatic Chain of Thought Prompting in Large Language Models 7 Oct 2022 · 5 repositories · arXiv:2210.03493Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
DABERT: Dual Attention Enhanced BERT for Semantic Matching 7 Oct 2022 · 0 repositories · arXiv:2210.03454
-
Generating Quizzes to Support Training on Quality Management and Assurance in Space Science and Engineering 7 Oct 2022 · 0 repositories · arXiv:2210.03427
-
How Large Language Models are Transforming Machine-Paraphrased Plagiarism 7 Oct 2022 · 3 repositories · arXiv:2210.03568
-
Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding 7 Oct 2022 · 1 repository · arXiv:2210.03304Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Measuring and Narrowing the Compositionality Gap in Language Models 7 Oct 2022 · 1 repository · arXiv:2210.03350
-
LLMEffiChecker: Understanding and Testing Efficiency Degradation of Large Language Models 7 Oct 2022 · 1 repository · arXiv:2210.03696
-
UU-Tax at SemEval-2022 Task 3: Improving the generalizability of language models for taxonomy classification through data augmentation 7 Oct 2022 · 1 repository · arXiv:2210.03378
-
Binding Language Models in Symbolic Languages 6 Oct 2022 · 4 repositories · arXiv:2210.02875Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputs 6 Oct 2022 · 1 repository · arXiv:2210.03052
-
Explainable Verbal Deception Detection using Transformers 6 Oct 2022 · 0 repositories · arXiv:2210.03080
-
Generalization Properties of Retrieval-based Models 6 Oct 2022 · 0 repositories · arXiv:2210.02617
-
Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners 6 Oct 2022 · 1 repository · arXiv:2210.02969
-
Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering 6 Oct 2022 · 1 repository · arXiv:2210.02627
-
Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer 6 Oct 2022 · 0 repositories · arXiv:2210.02729
-
Matching Text and Audio Embeddings: Exploring Transfer-learning Strategies for Language-based Audio Retrieval 6 Oct 2022 · 0 repositories · arXiv:2210.02833
-
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text 6 Oct 2022 · 0 repositories · arXiv:2210.02928
-
Rainier: Reinforced Knowledge Introspector for Commonsense Question Answering 6 Oct 2022 · 1 repository · arXiv:2210.03078Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 4 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples)
-
GLM-130B: An Open Bilingual Pre-trained Model 5 Oct 2022 · 9 repositories · arXiv:2210.02414Syntology official (archive's flag): 9 ran · 15 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 21 harvested samples)
-
Privacy-Preserving Text Classification on BERT Embeddings with Homomorphic Encryption 5 Oct 2022 · 0 repositories · arXiv:2210.02574
-
Revisiting Structured Dropout 5 Oct 2022 · 0 repositories · arXiv:2210.02570
-
Explaining Patterns in Data with Language Models via Interpretable Autoprompting 4 Oct 2022 · 2 repositories · arXiv:2210.01848Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
The (In)Effectiveness of Intermediate Task Training For Domain Adaptation and Cross-Lingual Transfer Learning 3 Oct 2022 · 0 repositories · arXiv:2210.01091
-
Complexity-Based Prompting for Multi-Step Reasoning 3 Oct 2022 · 0 repositories · arXiv:2210.00720
-
Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought 3 Oct 2022 · 2 repositories · arXiv:2210.01240Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Probing of Quantitative Values in Abstractive Summarization Models 3 Oct 2022 · 0 repositories · arXiv:2210.00667
-
Construction and Evaluation of a Self-Attention Model for Semantic Understanding of Sentence-Final Particles 1 Oct 2022 · 0 repositories · arXiv:2210.00282
-
LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph Embeddings 1 Oct 2022 · 2 repositories · arXiv:2210.00305
-
Underspecification in Language Modeling Tasks: A Causality-Informed Study of Gendered Pronoun Resolution 30 Sep 2022 · 2 repositories · arXiv:2210.00131
-
SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation 30 Sep 2022 · 1 repository · arXiv:2209.15323
-
Bidirectional Language Models Are Also Few-shot Learners 29 Sep 2022 · 0 repositories · arXiv:2209.14500
-
Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning 29 Sep 2022 · 2 repositories · arXiv:2209.14610Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples)
-
CEFER: A Four Facets Framework based on Context and Emotion embedded features for Implicit and Explicit Emotion Recognition 28 Sep 2022 · 0 repositories · arXiv:2209.13999
-
Downstream Datasets Make Surprisingly Good Pretraining Corpora 28 Sep 2022 · 1 repository · arXiv:2209.14389
-
Medical Image Captioning via Generative Pretrained Transformers 28 Sep 2022 · 0 repositories · arXiv:2209.13983