Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 36
Linear Warmup With Linear Decay
Papers archive 2025-07-28
archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)
Page 36 of 71: papers 3,501 to 3,600 of 7,076, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
BiT: Robustly Binarized Multi-distilled Transformer 25 May 2022 · 3 repositories · arXiv:2205.13016Syntology official (archive's flag): 2 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Lifelong Learning Natural Language Processing Approach for Multilingual Data Classification 25 May 2022 · 0 repositories · arXiv:2206.11867
-
ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data 25 May 2022 · 0 repositories · arXiv:2205.12600
-
RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning 25 May 2022 · 1 repository · arXiv:2205.12598Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
Text-to-Face Generation with StyleGAN2 25 May 2022 · 0 repositories · arXiv:2205.12512
-
Do we need Label Regularization to Fine-tune Pre-trained Language Models? 25 May 2022 · 0 repositories · arXiv:2205.12428
-
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models 25 May 2022 · 0 repositories · arXiv:2205.12694
-
Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling 25 May 2022 · 1 repository · arXiv:2205.12986Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection 25 May 2022 · 1 repository · arXiv:2205.12424
-
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition 24 May 2022 · 1 repository · arXiv:2205.11799
-
K-12BERT: BERT for K-12 education 24 May 2022 · 1 repository · arXiv:2205.12335
-
On the Role of Bidirectionality in Language Model Pre-Training 24 May 2022 · 0 repositories · arXiv:2205.11726
-
Partial-input baselines show that NLI models can ignore context, but they don't 24 May 2022 · 1 repository · arXiv:2205.12181
-
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder 24 May 2022 · 1 repository · arXiv:2205.12035
-
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT 24 May 2022 · 1 repository · arXiv:2205.12399
-
Word-order typology in Multilingual BERT: A case study in subordinate-clause detection 24 May 2022 · 0 repositories · arXiv:2205.11987
-
Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita 23 May 2022 · 1 repository · arXiv:2205.11020
-
KOLD: Korean Offensive Language Dataset 23 May 2022 · 1 repository · arXiv:2205.11315
-
Learning to Ignore Adversarial Attacks 23 May 2022 · 0 repositories · arXiv:2205.11551
-
On the Paradox of Learning to Reason from Data 23 May 2022 · 1 repository · arXiv:2205.11502Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
Outliers Dimensions that Disrupt Transformers Are Driven by Frequency 23 May 2022 · 1 repository · arXiv:2205.11380Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 16 harvested samples)
-
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning 23 May 2022 · 2 repositories · arXiv:2205.11005Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Prompt Tuning for Discriminative Pre-trained Language Models 23 May 2022 · 1 repository · arXiv:2205.11166Syntology official (archive's flag): 7 ran · 7 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples)
-
The Diminishing Returns of Masked Language Models to Science 23 May 2022 · 0 repositories · arXiv:2205.11342
-
Simple Recurrence Improves Masked Language Models 23 May 2022 · 0 repositories · arXiv:2205.11588
-
A Graph Enhanced BERT Model for Event Prediction 22 May 2022 · 0 repositories · arXiv:2205.10822
-
GraphMAE: Self-Supervised Masked Graph Autoencoders 22 May 2022 · 3 repositories · arXiv:2205.10803Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
A Study on Transformer Configuration and Training Objective 21 May 2022 · 0 repositories · arXiv:2205.10505
-
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese 21 May 2022 · 1 repository · arXiv:2205.10517
-
Current Trends and Approaches in Synonyms Extraction: Potential Adaptation to Arabic 20 May 2022 · 0 repositories · arXiv:2205.10412
-
Exploring Extreme Parameter Compression for Pre-trained Language Models 20 May 2022 · 1 repository · arXiv:2205.10036
-
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection 20 May 2022 · 0 repositories · arXiv:2205.10455
-
Progressive Class Semantic Matching for Semi-supervised Text Classification 20 May 2022 · 1 repository · arXiv:2205.10189
-
ArabGlossBERT: Fine-Tuning BERT on Context-Gloss Pairs for WSD 19 May 2022 · 0 repositories · arXiv:2205.09685
-
Automated Scoring for Reading Comprehension via In-context BERT Tuning 19 May 2022 · 1 repository · arXiv:2205.09864
-
Overcoming Language Disparity in Online Content Classification with Multimodal Learning 19 May 2022 · 1 repository · arXiv:2205.09744
-
Psychiatric Scale Guided Risky Post Screening for Early Detection of Depression 19 May 2022 · 1 repository · arXiv:2205.09497
-
Learning Rate Curriculum 18 May 2022 · 1 repository · arXiv:2205.09180
-
Persian Natural Language Inference: A Meta-learning approach 18 May 2022 · 1 repository · arXiv:2205.08755
-
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT 17 May 2022 · 0 repositories · arXiv:2205.08497
-
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation 17 May 2022 · 0 repositories · arXiv:2205.08180
-
SEMI-FND: Stacked Ensemble Based Multimodal Inference For Faster Fake News Detection 17 May 2022 · 0 repositories · arXiv:2205.08159
-
ViralBERT: A User Focused BERT-Based Approach to Virality Prediction 17 May 2022 · 1 repository · arXiv:2206.10298
-
Chemical transformer compression for accelerating both training and inference of molecular modeling 16 May 2022 · 1 repository · arXiv:2205.07582
-
Harnessing Multilingual Resources to Question Answering in Arabic 16 May 2022 · 0 repositories · arXiv:2205.08024
-
Discovering Latent Concepts Learned in BERT 15 May 2022 · 0 repositories · arXiv:2205.07237
-
Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT 15 May 2022 · 1 repository · arXiv:2205.07180
-
Fake News Quick Detection on Dynamic Heterogeneous Information Networks 14 May 2022 · 0 repositories · arXiv:2205.07039
-
Naturalistic Causal Probing for Morpho-Syntax 14 May 2022 · 1 repository · arXiv:2205.07043
-
A Study of the Attention Abnormality in Trojaned BERTs 13 May 2022 · 1 repository · arXiv:2205.08305Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Improving Contextual Representation with Gloss Regularized Pre-training 13 May 2022 · 0 repositories · arXiv:2205.06603
-
AppTek's Submission to the IWSLT 2022 Isometric Spoken Language Translation Task 12 May 2022 · 0 repositories · arXiv:2205.05807
-
Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models? 12 May 2022 · 0 repositories · arXiv:2205.06149
-
NER-MQMRC: Formulating Named Entity Recognition as Multi Question Machine Reading Comprehension 12 May 2022 · 0 repositories · arXiv:2205.05904
-
A time-varying study of Chinese investor sentiment, stock market liquidity and volatility: Based on deep learning BERT model and TVP-VAR model 11 May 2022 · 0 repositories · arXiv:2205.05719
-
Query-Based Keyphrase Extraction from Long Documents 11 May 2022 · 1 repository · arXiv:2205.05391
-
Deep learning based Chinese text sentiment mining and stock market correlation research 10 May 2022 · 0 repositories · arXiv:2205.04743
-
Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words 10 May 2022 · 2 repositories · arXiv:2205.05092
-
Automated Evaluation for Student Argumentative Writing: A Survey 9 May 2022 · 0 repositories · arXiv:2205.04083
-
Long Document Re-ranking with Modular Re-ranker 9 May 2022 · 1 repository · arXiv:2205.04275
-
Research on the correlation between text emotion mining and stock market based on deep learning 9 May 2022 · 0 repositories · arXiv:2205.06675
-
On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation 8 May 2022 · 1 repository · arXiv:2205.03835
-
AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury 7 May 2022 · 1 repository · arXiv:2205.03695
-
EmotionFlow: Capture the Dialogue Level Emotion Transitions 7 May 2022 · 1 repository
-
Improving Downstream Task Performance by Treating Numbers as Entities 7 May 2022 · 0 repositories · arXiv:2205.03559
-
A Data Cartography based MixUp for Pre-trained Language Models 6 May 2022 · 1 repository · arXiv:2205.03403
-
Stock Price Prediction Based on Natural Language Processing 6 May 2022 · 2 repositories
-
BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog 5 May 2022 · 1 repository · arXiv:2205.02471
-
Exploiting Global and Local Hierarchies for Hierarchical Text Classification 5 May 2022 · 1 repository · arXiv:2205.02613
-
Hyperbolic Relevance Matching for Neural Keyphrase Extraction 4 May 2022 · 1 repository · arXiv:2205.02047
-
Using virtual edges to extract keywords from texts modeled as complex networks 4 May 2022 · 0 repositories · arXiv:2205.02172
-
Efficient Fine-Tuning of BERT Models on the Edge 3 May 2022 · 0 repositories · arXiv:2205.01541
-
Explain and Conquer: Personalised Text-based Reviews to Achieve Transparency 3 May 2022 · 0 repositories · arXiv:2205.01759
-
Finding patterns in Knowledge Attribution for Transformers 3 May 2022 · 0 repositories · arXiv:2205.01366
-
Predicting Issue Types with seBERT 3 May 2022 · 1 repository · arXiv:2205.01335
-
SemAttack: Natural Textual Attacks via Different Semantic Spaces 3 May 2022 · 1 repository · arXiv:2205.01287Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
BERTops: Studying BERT Representations under a Topological Lens 2 May 2022 · 1 repository · arXiv:2205.00953
-
Entity-aware Transformers for Entity Search 2 May 2022 · 1 repository · arXiv:2205.00820
-
Gradient Descent, Stochastic Optimization, and Other Tales 2 May 2022 · 0 repositories · arXiv:2205.00832
-
Improving Students' Academic Performance with AI and Semantic Technologies 2 May 2022 · 1 repository · arXiv:2206.03213
-
Detecting COVID-19 Conspiracy Theories with Transformers and TF-IDF 1 May 2022 · 0 repositories · arXiv:2205.00377
-
StorSeismic: A new paradigm in deep learning for seismic processing 30 Apr 2022 · 1 repository · arXiv:2205.00222
-
ExaASC: A General Target-Based Stance Detection Corpus in Arabic Language 29 Apr 2022 · 1 repository · arXiv:2204.13979
-
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance 29 Apr 2022 · 0 repositories · arXiv:2204.13921
-
RobBERTje: a Distilled Dutch BERT Model 28 Apr 2022 · 0 repositories · arXiv:2204.13511
-
Better Query Graph Selection for Knowledge Base Question Answering 27 Apr 2022 · 0 repositories · arXiv:2204.12662
-
Modern Baselines for SPARQL Semantic Parsing 27 Apr 2022 · 1 repository · arXiv:2204.12793
-
RigoBERTa: A State-of-the-Art Language Model For Spanish 27 Apr 2022 · 0 repositories · arXiv:2205.10233
-
SkillSpan: Hard and Soft Skill Extraction from English Job Postings 27 Apr 2022 · 1 repository · arXiv:2204.12811
-
BiTimeBERT: Extending Pre-Trained Language Representations with Bi-Temporal Information 27 Apr 2022 · 0 repositories · arXiv:2204.13032
-
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval 26 Apr 2022 · 1 repository · arXiv:2204.12408
-
PLOD: An Abbreviation Detection Dataset for Scientific Documents 26 Apr 2022 · 1 repository · arXiv:2204.12061
-
Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors 26 Apr 2022 · 0 repositories · arXiv:2204.12052
-
Evaluating Interpolation and Extrapolation Performance of Neural Retrieval Models 25 Apr 2022 · 1 repository · arXiv:2204.11447
-
Groupwise Query Performance Prediction with BERT 25 Apr 2022 · 1 repository · arXiv:2204.11489
-
Faster Learned Sparse Retrieval with Guided Traversal 24 Apr 2022 · 1 repository · arXiv:2204.11314
-
Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training 24 Apr 2022 · 1 repository · arXiv:2204.11218
-
Fine-Tuning BERT Models to Classify Misinformation on Garlic and COVID-19 on Twitter 22 Apr 2022 · 0 repositories
-
Taygete at SemEval-2022 Task 4: RoBERTa based models for detecting Patronising and Condescending Language 22 Apr 2022 · 0 repositories · arXiv:2204.10519
-
WaBERT: A Low-resource End-to-end Model for Spoken Language Understanding and Speech-to-BERT Alignment 22 Apr 2022 · 0 repositories · arXiv:2204.10461