Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 48
Linear Warmup With Linear Decay
Papers archive 2025-07-28
archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)
Page 48 of 71: papers 4,701 to 4,800 of 7,076, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Neural Abstractive Unsupervised Summarization of Online News Discussions 7 Jun 2021 · 1 repository · arXiv:2106.03953
-
Never guess what I heard... Rumor Detection in Finnish News: a Dataset and a Baseline 7 Jun 2021 · 0 repositories · arXiv:2106.03389
-
Causal Abstractions of Neural Networks 6 Jun 2021 · 1 repository · arXiv:2106.02997
-
Transient Chaos in BERT 6 Jun 2021 · 0 repositories · arXiv:2106.03181
-
BERTnesia: Investigating the capture and forgetting of knowledge in BERT 5 Jun 2021 · 1 repository · arXiv:2106.02902
-
BERT-Based Sentiment Analysis: A Software Engineering Perspective 4 Jun 2021 · 2 repositories · arXiv:2106.02581
-
Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing 4 Jun 2021 · 0 repositories · arXiv:2106.02559
-
ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression 4 Jun 2021 · 1 repository · arXiv:2106.02241
-
Towards Equal Gender Representation in the Annotations of Toxic Language Detection 4 Jun 2021 · 0 repositories · arXiv:2106.02183
-
You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient 4 Jun 2021 · 1 repository · arXiv:2106.02435
-
Auto-tagging of Short Conversational Sentences using Transformer Methods 3 Jun 2021 · 0 repositories · arXiv:2106.01735
-
BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions 3 Jun 2021 · 0 repositories · arXiv:2106.01536
-
CCPM: A Chinese Classical Poetry Matching Dataset 3 Jun 2021 · 1 repository · arXiv:2106.01979
-
Defending Democracy: Using Deep Learning to Identify and Prevent Misinformation 3 Jun 2021 · 0 repositories · arXiv:2106.02607
-
Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech 3 Jun 2021 · 1 repository · arXiv:2106.01625Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Self-Guided Contrastive Learning for BERT Sentence Representations 3 Jun 2021 · 1 repository · arXiv:2106.07345Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Template-Based Named Entity Recognition Using BART 3 Jun 2021 · 1 repository · arXiv:2106.01760
-
The Limitations of Limited Context for Constituency Parsing 3 Jun 2021 · 0 repositories · arXiv:2106.01580
-
"You made me feel this way": Investigating Partners' Influence in Predicting Emotions in Couples' Conflict Interactions using Speech Data 3 Jun 2021 · 0 repositories · arXiv:2106.01526
-
belabBERT: a Dutch RoBERTa-based language model applied to psychiatric classification 2 Jun 2021 · 0 repositories · arXiv:2106.01091
-
Differential Privacy for Text Analytics via Natural Text Sanitization 2 Jun 2021 · 1 repository · arXiv:2106.01221Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Evaluating the Efficacy of Summarization Evaluation across Languages 2 Jun 2021 · 1 repository · arXiv:2106.01478
-
MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Education 2 Jun 2021 · 1 repository · arXiv:2106.07340Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers 2 Jun 2021 · 0 repositories · arXiv:2106.01335
-
Self-Supervised Document Similarity Ranking via Contextualized Language Models and Hierarchical Inference 2 Jun 2021 · 1 repository · arXiv:2106.01186
-
T-BERT -- Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT 2 Jun 2021 · 0 repositories · arXiv:2106.01097
-
An Architecture for Accelerated Large-Scale Inference of Transformer-Based Language Models 1 Jun 2021 · 0 repositories
-
Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis 1 Jun 2021 · 0 repositories
-
Cost-effective Deployment of BERT Models in Serverless Environment 1 Jun 2021 · 0 repositories
-
Cultural and Geographical Influences on Image Translatability of Words across Languages 1 Jun 2021 · 1 repository
-
Domain Adaptation for Arabic Cross-Domain and Cross-Dialect Sentiment Analysis from Contextualized Word Embedding 1 Jun 2021 · 1 repository
-
DReCa: A General Task Augmentation Strategy for Few-Shot Natural Language Inference 1 Jun 2021 · 0 repositories
-
Dual-Objective Fine-Tuning of BERT for Entity Matching 1 Jun 2021 · 1 repository
-
Emotion-Infused Models for Explainable Psychological Stress Detection 1 Jun 2021 · 1 repository
-
Iterative Hierarchical Attention for Answering Complex Questions over Long Documents 1 Jun 2021 · 0 repositories · arXiv:2106.00200
-
HONEST: Measuring Hurtful Sentence Completion in Language Models 1 Jun 2021 · 1 repository
-
Improving Automatic Hate Speech Detection with Multiword Expression Features 1 Jun 2021 · 0 repositories · arXiv:2106.00237
-
Multi-Grained Knowledge Distillation for Named Entity Recognition 1 Jun 2021 · 0 repositories
-
Negation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish. 1 Jun 2021 · 0 repositories
-
On using distributed representations of source code for the detection of C security vulnerabilities 1 Jun 2021 · 1 repository · arXiv:2106.01367
-
QuadrupletBERT: An Efficient Model For Embedding-Based Large-Scale Retrieval 1 Jun 2021 · 0 repositories
-
SCRIPT: Self-Critic PreTraining of Transformers 1 Jun 2021 · 0 repositories
-
Shuffled-token Detection for Refining Pre-trained RoBERTa 1 Jun 2021 · 0 repositories
-
Towards a Comprehensive Understanding and Accurate Evaluation of Societal Biases in Pre-Trained Transformers 1 Jun 2021 · 0 repositories
-
Training Language Models under Resource Constraints for Adversarial Advertisement Detection 1 Jun 2021 · 0 repositories
-
Using Integrated Gradients and Constituency Parse Trees to explain Linguistic Acceptability learnt by BERT 1 Jun 2021 · 0 repositories · arXiv:2106.07349
-
WikiTalkEdit: A Dataset for modeling Editors' behaviors on Wikipedia 1 Jun 2021 · 0 repositories
-
You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection 1 Jun 2021 · 2 repositories · arXiv:2106.00666Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples) · 5 pointer-only (licence)
-
How transfer learning impacts linguistic knowledge in deep NLP models? 31 May 2021 · 0 repositories · arXiv:2105.15179
-
Training ELECTRA Augmented with Multi-word Selection 31 May 2021 · 0 repositories · arXiv:2106.00139
-
Zero-shot Fact Verification by Claim Generation 31 May 2021 · 1 repository · arXiv:2105.14682Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
A Compression-Compilation Framework for On-mobile Real-time BERT Applications 30 May 2021 · 0 repositories · arXiv:2106.00526
-
Drop Clause: Enhancing Performance, Interpretability and Robustness of the Tsetlin Machine 30 May 2021 · 7 repositories · arXiv:2105.14506
-
LRTuner: A Learning Rate Tuner for Deep Neural Networks 30 May 2021 · 2 repositories · arXiv:2105.14526
-
LEAP: Learnable Pruning for Transformer-based Models 30 May 2021 · 1 repository · arXiv:2105.14636Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search 30 May 2021 · 0 repositories · arXiv:2105.14444
-
Neural Models for Offensive Language Detection 30 May 2021 · 0 repositories · arXiv:2106.14609
-
A Simple Voting Mechanism for Online Sexist Content Identification 29 May 2021 · 0 repositories · arXiv:2105.14309
-
Constructing Flow Graphs from Procedural Cybersecurity Texts 29 May 2021 · 1 repository · arXiv:2105.14357
-
Sentiment analysis in tweets: an assessment study from classical to modern text representation models 29 May 2021 · 1 repository · arXiv:2105.14373
-
Accelerating BERT Inference for Sequence Labeling via Early-Exit 28 May 2021 · 1 repository · arXiv:2105.13878
-
Domain-Adaptive Pretraining Methods for Dialogue Understanding 28 May 2021 · 0 repositories · arXiv:2105.13665
-
SciFive: a text-to-text transformer model for biomedical literature 28 May 2021 · 1 repository · arXiv:2106.03598Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Weighted Training for Cross-Task Learning 28 May 2021 · 1 repository · arXiv:2105.14095Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Contrastive Fine-tuning Improves Robustness for Neural Rankers 27 May 2021 · 0 repositories · arXiv:2105.12932
-
Leveraging Linguistic Coordination in Reranking N-Best Candidates For End-to-End Response Selection Using BERT 27 May 2021 · 0 repositories · arXiv:2105.13479
-
MixQA: Embedding and Answer Mixing for Question Answering 27 May 2021 · 0 repositories
-
Path-based knowledge reasoning with textual semantic information for medical knowledge graph completion 27 May 2021 · 0 repositories · arXiv:2105.13074
-
RAW-C: Relatedness of Ambiguous Words--in Context (A New Lexical Resource for English) 27 May 2021 · 1 repository · arXiv:2105.13266
-
Verb Sense Clustering using Contextualized Word Representations for Semantic Frame Induction 27 May 2021 · 0 repositories · arXiv:2105.13465
-
A Full-Stack Search Technique for Domain Optimized Deep Learning Accelerators 26 May 2021 · 0 repositories · arXiv:2105.12842
-
BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition 26 May 2021 · 2 repositories · arXiv:2105.12848Syntology official (archive's flag): 7 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 10 unverified (of 20 harvested samples)
-
Deception detection in text and its relation to the cultural dimension of individualism/collectivism 26 May 2021 · 0 repositories · arXiv:2105.12530
-
Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading 26 May 2021 · 1 repository · arXiv:2105.12825Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Zero-shot Medical Entity Retrieval without Annotation: Learning From Rich Knowledge Graph Semantics 26 May 2021 · 0 repositories · arXiv:2105.12682
-
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer 25 May 2021 · 1 repository · arXiv:2105.11741
-
Context-Sensitive Visualization of Deep Learning Natural Language Processing Models 25 May 2021 · 0 repositories · arXiv:2105.12202
-
Enhance Multimodal Model Performance with Data Augmentation: Facebook Hateful Meme Challenge Solution 25 May 2021 · 1 repository · arXiv:2105.13132
-
Extending the Abstraction of Personality Types based on MBTI with Machine Learning and Natural Language Processing 25 May 2021 · 0 repositories · arXiv:2105.11798
-
NukeLM: Pre-Trained and Fine-Tuned Language Models for the Nuclear and Energy Domains 25 May 2021 · 0 repositories · arXiv:2105.12192
-
Personalized Transformer for Explainable Recommendation 25 May 2021 · 1 repository · arXiv:2105.11601Syntology official (archive's flag): 6 ran · 6 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference 25 May 2021 · 1 repository · arXiv:2105.11618
-
ViBERTgrid: A Jointly Trained Multi-Modal 2D Document Representation for Key Information Extraction from Documents 25 May 2021 · 0 repositories · arXiv:2105.11672
-
Classifying Math KCs via Task-Adaptive Pre-Trained BERT 24 May 2021 · 0 repositories · arXiv:2105.11343
-
DaN+: Danish Nested Named Entities and Lexical Normalization 24 May 2021 · 1 repository · arXiv:2105.11301
-
De-identification of Privacy-related Entities in Job Postings 24 May 2021 · 1 repository · arXiv:2105.11223
-
Diacritics Restoration using BERT with Analysis on Czech language 24 May 2021 · 1 repository · arXiv:2105.11408Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Fine-grained Post-training for Improving Retrieval-based Dialogue Systems 24 May 2021 · 1 repository
-
Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training 24 May 2021 · 1 repository · arXiv:2105.11333Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Neural Language Models for Nineteenth-Century English 24 May 2021 · 2 repositories · arXiv:2105.11321
-
RobeCzech: Czech RoBERTa, a monolingual contextualized language representation model 24 May 2021 · 0 repositories · arXiv:2105.11314
-
Using Adversarial Attacks to Reveal the Statistical Bias in Machine Reading Comprehension Models 24 May 2021 · 0 repositories · arXiv:2105.11136
-
CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding 23 May 2021 · 1 repository · arXiv:2105.10912
-
Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs 23 May 2021 · 0 repositories · arXiv:2105.10909
-
AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly 22 May 2021 · 1 repository · arXiv:2105.10762Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Denoising Noisy Neural Networks: A Bayesian Approach with Compensation 22 May 2021 · 1 repository · arXiv:2105.10699
-
Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learning 21 May 2021 · 0 repositories · arXiv:2105.10195
-
Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media 21 May 2021 · 0 repositories · arXiv:2105.10272
-
Towards Automatic Comparison of Data Privacy Documents: A Preliminary Experiment on GDPR-like Laws 21 May 2021 · 1 repository · arXiv:2105.10117
-
A comparative evaluation and analysis of three generations of Distributional Semantic Models 20 May 2021 · 1 repository · arXiv:2105.09825