Methods › General › Regularization › Attention Dropout › Papers, page 53
Attention Dropout
Papers archive 2025-07-28
archive papers tagged: 10,892 · with a code link: 4,634 · where Syntology ran a sample: 1,270 (1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1,270 of 10,892 tagged: 1,043 with a run with no instrument failure, 227 where every run was a failure of Syntology's instrument)
Page 53 of 109: papers 5,201 to 5,300 of 10,892, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
The Curse of Recursion: Training on Generated Data Makes Models Forget 27 May 2023 · 1 repository · arXiv:2305.17493
-
Modeling Adversarial Attack on Pre-trained Language Models as Sequential Decision Making 27 May 2023 · 1 repository · arXiv:2305.17440
-
Towards Explainable Conversational Recommender Systems 27 May 2023 · 1 repository · arXiv:2305.18363
-
What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks 27 May 2023 · 1 repository · arXiv:2305.18365
-
Backpack Language Models 26 May 2023 · 1 repository · arXiv:2305.16765Syntology 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 4 harvested samples)
-
Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models 26 May 2023 · 2 repositories · arXiv:2305.16582Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Calibration of Transformer-based Models for Identifying Stress and Depression in Social Media 26 May 2023 · 0 repositories · arXiv:2305.16797
-
Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance 26 May 2023 · 1 repository · arXiv:2305.17306Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
ChatGPT: A Study on its Utility for Ubiquitous Software Engineering Tasks 26 May 2023 · 0 repositories · arXiv:2305.16837
-
Counterfactual reasoning: Testing language models' understanding of hypothetical scenarios 26 May 2023 · 1 repository · arXiv:2305.16572
-
Distinguishing Human Generated Text From ChatGPT Generated Text Using Machine Learning 26 May 2023 · 0 repositories · arXiv:2306.01761
-
Do GPTs Produce Less Literal Translations? 26 May 2023 · 1 repository · arXiv:2305.16806
-
Evaluation of Question Generation Needs More References 26 May 2023 · 0 repositories · arXiv:2305.16626
-
GeoVLN: Learning Geometry-Enhanced Visual Representation with Slot Attention for Vision-and-Language Navigation 26 May 2023 · 1 repository · arXiv:2305.17102
-
Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing 26 May 2023 · 0 repositories · arXiv:2305.16635
-
Improving accuracy of GPT-3/4 results on biomedical data using a retrieval-augmented language model 26 May 2023 · 0 repositories · arXiv:2305.17116
-
Incorporating Distributions of Discourse Structure for Long Document Abstractive Summarization 26 May 2023 · 0 repositories · arXiv:2305.16784
-
KNSE: A Knowledge-aware Natural Language Inference Framework for Dialogue Symptom Status Recognition 26 May 2023 · 0 repositories · arXiv:2305.16833
-
Large Language Models as Tool Makers 26 May 2023 · 1 repository · arXiv:2305.17126
-
Learning and Leveraging Verifiers to Improve Planning Capabilities of Pre-trained Language Models 26 May 2023 · 0 repositories · arXiv:2305.17077
-
Learning to Imagine: Visually-Augmented Natural Language Generation 26 May 2023 · 1 repository · arXiv:2305.16944Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations 26 May 2023 · 1 repository · arXiv:2305.18354
-
NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models 26 May 2023 · 2 repositories · arXiv:2305.16986Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 2 pointer-only (licence)
-
Playing repeated games with Large Language Models 26 May 2023 · 0 repositories · arXiv:2305.16867
-
Theoretical and Practical Perspectives on what Influence Functions Do 26 May 2023 · 0 repositories · arXiv:2305.16971
-
Zero is Not Hero Yet: Benchmarking Zero-Shot Performance of LLMs for Financial Tasks 26 May 2023 · 1 repository · arXiv:2305.16633
-
A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutions 25 May 2023 · 0 repositories · arXiv:2305.18339
-
Comparative Study of Pre-Trained BERT Models for Code-Mixed Hindi-English Data 25 May 2023 · 0 repositories · arXiv:2305.15722
-
Context-aware attention layers coupled with optimal transport domain adaptation and multimodal fusion methods for recognizing dementia from spontaneous speech 25 May 2023 · 0 repositories · arXiv:2305.16406
-
Linguistic Properties of Truthful Response 25 May 2023 · 1 repository · arXiv:2305.15875
-
Not wacky vs. definitely wacky: A study of scalar adverbs in pretrained language models 25 May 2023 · 0 repositories · arXiv:2305.16426
-
Pre-training Meets Clustering: A Hybrid Extractive Multi-document Summarization Model 25 May 2023 · 1 repository
-
Text-to-Motion Retrieval: Towards Joint Understanding of Human Motion Data and Natural Language 25 May 2023 · 1 repository · arXiv:2305.15842
-
A Causal View of Entity Bias in (Large) Language Models 24 May 2023 · 1 repository · arXiv:2305.14695Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
LAraBench: Benchmarking Arabic AI with Large Language Models 24 May 2023 · 0 repositories · arXiv:2305.14982
-
Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering 24 May 2023 · 0 repositories · arXiv:2305.14901
-
ChatAgri: Exploring Potentials of ChatGPT on Cross-linguistic Agricultural Text Classification 24 May 2023 · 1 repository · arXiv:2305.15024
-
Complex Mathematical Symbol Definition Structures: A Dataset and Model for Coordination Resolution in Definition Extraction 24 May 2023 · 1 repository · arXiv:2305.14660
-
Context-Aware Transformer Pre-Training for Answer Sentence Selection 24 May 2023 · 0 repositories · arXiv:2305.15358
-
Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewriting 24 May 2023 · 0 repositories · arXiv:2305.14755
-
Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMs 24 May 2023 · 0 repositories · arXiv:2305.16339
-
Dynamic Masking Rate Schedules for MLM Pretraining 24 May 2023 · 0 repositories · arXiv:2305.15096
-
Editing Common Sense in Transformers 24 May 2023 · 1 repository · arXiv:2305.14956Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples)
-
ExpertPrompting: Instructing Large Language Models to be Distinguished Experts 24 May 2023 · 2 repositories · arXiv:2305.14688Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Extracting Psychological Indicators Using Question Answering 24 May 2023 · 0 repositories · arXiv:2305.14891
-
Ghostbuster: Detecting Text Ghostwritten by Large Language Models 24 May 2023 · 2 repositories · arXiv:2305.15047
-
Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translation 24 May 2023 · 1 repository · arXiv:2305.15541Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models 24 May 2023 · 1 repository · arXiv:2305.15074Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives 24 May 2023 · 1 repository · arXiv:2305.15032Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Psychological Metrics for Dialog System Evaluation 24 May 2023 · 0 repositories · arXiv:2305.14757
-
I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphors 24 May 2023 · 1 repository · arXiv:2305.14724
-
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning 24 May 2023 · 1 repository · arXiv:2305.15065Syntology official (archive's flag): 9 ran · 9 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples)
-
Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMs 24 May 2023 · 0 repositories · arXiv:2305.16344
-
LLMDet: A Third Party Large Language Models Generated Text Detection Tool 24 May 2023 · 1 repository · arXiv:2305.15004Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
-
Mastering the ABCDs of Complex Questions: Answer-Based Claim Decomposition for Fine-grained Self-Evaluation 24 May 2023 · 0 repositories · arXiv:2305.14750
-
Neural Summarization of Electronic Health Records 24 May 2023 · 0 repositories · arXiv:2305.15222
-
Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answering 24 May 2023 · 1 repository · arXiv:2305.15387Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 18 harvested samples)
-
Revisiting Token Dropping Strategy in Efficient BERT Pretraining 24 May 2023 · 1 repository · arXiv:2305.15273
-
Segmented Recurrent Transformer: An Efficient Sequence-to-Sequence Model 24 May 2023 · 1 repository · arXiv:2305.16340
-
Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models 24 May 2023 · 1 repository · arXiv:2305.14623Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Testing Causal Models of Word Meaning in GPT-3 and -4 24 May 2023 · 1 repository · arXiv:2305.14630
-
ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind 24 May 2023 · 1 repository · arXiv:2305.15068
-
Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreaks 24 May 2023 · 1 repository · arXiv:2305.14965Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding 24 May 2023 · 3 repositories · arXiv:2305.14739Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings 23 May 2023 · 0 repositories · arXiv:2305.14521
-
When your Cousin has the Right Connections: Unsupervised Bilingual Lexicon Induction for Related Data-Imbalanced Languages 23 May 2023 · 1 repository · arXiv:2305.14012
-
A Trip Towards Fairness: Bias and De-Biasing in Large Language Models 23 May 2023 · 0 repositories · arXiv:2305.13862
-
Active Learning Principles for In-Context Learning with Large Language Models 23 May 2023 · 0 repositories · arXiv:2305.14264
-
All Roads Lead to Rome? Exploring the Invariance of Transformers' Representations 23 May 2023 · 1 repository · arXiv:2305.14555Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Assessing Linguistic Generalisation in Language Models: A Dataset for Brazilian Portuguese 23 May 2023 · 0 repositories · arXiv:2305.14070
-
AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamese 23 May 2023 · 1 repository · arXiv:2305.13641
-
Fine-tuned LLMs Know More, Hallucinate Less with Few-Shot Sequence-to-Sequence Semantic Parsing over Wikidata 23 May 2023 · 1 repository · arXiv:2305.14202
-
Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification Using Graph Neural Networks? 23 May 2023 · 1 repository · arXiv:2305.14578
-
Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA 23 May 2023 · 0 repositories · arXiv:2305.14458
-
Deduction under Perturbed Evidence: Probing Student Simulation Capabilities of Large Language Models 23 May 2023 · 0 repositories · arXiv:2305.14507
-
Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation 23 May 2023 · 1 repository · arXiv:2305.14327Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 14 harvested samples)
-
Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering 23 May 2023 · 0 repositories · arXiv:2305.13691
-
Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentation 23 May 2023 · 0 repositories · arXiv:2305.13785
-
Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Control 23 May 2023 · 0 repositories · arXiv:2305.14459
-
Evaluating Factual Consistency of Summaries with Large Language Models 23 May 2023 · 2 repositories · arXiv:2305.14069
-
Exploring Large Language Models for Classical Philology 23 May 2023 · 1 repository · arXiv:2305.13698
-
GrACE: Generation using Associated Code Edits 23 May 2023 · 0 repositories · arXiv:2305.14129
-
Handling Realistic Label Noise in BERT Text Classification 23 May 2023 · 0 repositories · arXiv:2305.16337
-
HumBEL: A Human-in-the-Loop Approach for Evaluating Demographic Factors of Language Models in Human-Machine Conversations 23 May 2023 · 1 repository · arXiv:2305.14195
-
IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions 23 May 2023 · 0 repositories · arXiv:2305.14010
-
Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks 23 May 2023 · 1 repository · arXiv:2305.13782
-
INSTRUCTSCORE: Explainable Text Generation Evaluation with Finegrained Feedback 23 May 2023 · 2 repositories · arXiv:2305.14282
-
Let's Think Frame by Frame with VIP: A Video Infilling and Prediction Dataset for Evaluating Video Chain-of-Thought 23 May 2023 · 1 repository · arXiv:2305.13903
-
MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems 23 May 2023 · 1 repository · arXiv:2305.14536Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations 23 May 2023 · 0 repositories · arXiv:2305.14224
-
NAIL: Lexical Retrieval Indices with Efficient Non-Autoregressive Decoders 23 May 2023 · 0 repositories · arXiv:2305.14499
-
NarrativeXL: A Large-scale Dataset For Long-Term Memory Models 23 May 2023 · 1 repository · arXiv:2305.13877
-
On Robustness of Finetuned Transformer-based NLP Models 23 May 2023 · 1 repository · arXiv:2305.14453
-
Physics of Language Models: Part 1, Learning Hierarchical Language Structures 23 May 2023 · 0 repositories · arXiv:2305.13673
-
Probing Brain Context-Sensitivity with Masked-Attention Generation 23 May 2023 · 0 repositories · arXiv:2305.13863
-
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training 23 May 2023 · 7 repositories · arXiv:2305.14342Syntology 13 ran (of which 4 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 19 harvested samples)
-
Sources of Hallucination by Large Language Models on Inference Tasks 23 May 2023 · 1 repository · arXiv:2305.14552
-
Text Is All You Need: Learning Language Representations for Sequential Recommendation 23 May 2023 · 1 repository · arXiv:2305.13731Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
ReadMe++: Benchmarking Multilingual Language Models for Multi-Domain Readability Assessment 23 May 2023 · 1 repository · arXiv:2305.14463
-
Training Transitive and Commutative Multimodal Transformers with LoReTTa 23 May 2023 · 0 repositories · arXiv:2305.14243