Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 38
Linear Warmup With Linear Decay
Papers archive 2025-07-28
archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)
Page 38 of 71: papers 3,701 to 3,800 of 7,076, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Towards Explainable Evaluation Metrics for Natural Language Generation 21 Mar 2022 · 1 repository · arXiv:2203.11131
-
Build a Robust QA System with Transformer-based Mixture of Experts 20 Mar 2022 · 1 repository · arXiv:2204.09598
-
Cluster & Tune: Boost Cold Start Performance in Text Classification 20 Mar 2022 · 1 repository · arXiv:2203.10581Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
-
g2pW: A Conditional Weighted Softmax BERT for Polyphone Disambiguation in Mandarin 20 Mar 2022 · 1 repository · arXiv:2203.10430
-
How does the pre-training objective affect what large language models learn about linguistic properties? 20 Mar 2022 · 1 repository · arXiv:2203.10415
-
Perturbations in the Wild: Leveraging Human-Written Text Perturbations for Realistic Adversarial Attack and Defense 19 Mar 2022 · 1 repository · arXiv:2203.10346Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists 17 Mar 2022 · 1 repository · arXiv:2203.09192Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT 17 Mar 2022 · 1 repository · arXiv:2203.09055
-
Multilingual Detection of Personal Employment Status on Twitter 17 Mar 2022 · 1 repository · arXiv:2203.09178
-
AdapLeR: Speeding up Inference by Adaptive Length Reduction 16 Mar 2022 · 1 repository · arXiv:2203.08991
-
KinyaBERT: a Morphology-aware Kinyarwanda Language Model 16 Mar 2022 · 1 repository · arXiv:2203.08459Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples)
-
Label Semantics for Few Shot Named Entity Recognition 16 Mar 2022 · 1 repository · arXiv:2203.08985
-
Data Contamination: From Memorization to Exploitation 15 Mar 2022 · 1 repository · arXiv:2203.08242Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Do BERTs Learn to Use Browser User Interface? Exploring Multi-Step Tasks with Unified Vision-and-Language BERTs 15 Mar 2022 · 1 repository · arXiv:2203.07828Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost 15 Mar 2022 · 1 repository · arXiv:2203.07860Syntology official (archive's flag): 2 ran · 6 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 2 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Can pre-trained Transformers be used in detecting complex sensitive sentences? -- A Monsanto case study 14 Mar 2022 · 0 repositories · arXiv:2203.06793
-
The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models 14 Mar 2022 · 1 repository · arXiv:2203.07259
-
WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition 14 Mar 2022 · 0 repositories · arXiv:2203.06925
-
Investigating the Impact of COVID-19 on Education by Social Network Mining 13 Mar 2022 · 0 repositories · arXiv:2203.06584
-
SciNLI: A Corpus for Natural Language Inference on Scientific Text 13 Mar 2022 · 1 repository · arXiv:2203.06728
-
BiBERT: Accurate Fully Binarized BERT 12 Mar 2022 · 1 repository · arXiv:2203.06390
-
ELLE: Efficient Lifelong Pre-training for Emerging Data 12 Mar 2022 · 1 repository · arXiv:2203.06311Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
FiNER: Financial Numeric Entity Recognition for XBRL Tagging 12 Mar 2022 · 2 repositories · arXiv:2203.06482
-
MarkBERT: Marking Word Boundaries Improves Chinese BERT 12 Mar 2022 · 1 repository · arXiv:2203.06378
-
A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings 11 Mar 2022 · 1 repository · arXiv:2203.05877Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
BERTopic: Neural topic modeling with a class-based TF-IDF procedure 11 Mar 2022 · 3 repositories · arXiv:2203.05794Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples)
-
Hierarchical BERT for Medical Document Understanding 11 Mar 2022 · 0 repositories · arXiv:2204.09600
-
Using Word Embeddings to Analyze Protests News 11 Mar 2022 · 0 repositories · arXiv:2203.05875
-
verBERT: Automating Brazilian Case Law Document Multi-label Categorization Using BERT 11 Mar 2022 · 1 repository · arXiv:2203.06224
-
When classifying grammatical role, BERT doesn't care about word order... except when it matters 11 Mar 2022 · 1 repository · arXiv:2203.06204
-
A new approach to calculating BERTScore for automatic assessment of translation quality 10 Mar 2022 · 0 repositories · arXiv:2203.05598
-
Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in context 10 Mar 2022 · 1 repository · arXiv:2203.05648
-
Semantic Norm Recognition and its application to Portuguese Law 10 Mar 2022 · 0 repositories · arXiv:2203.05425
-
Speciesist Language and Nonhuman Animal Bias in English Masked Language Models 10 Mar 2022 · 1 repository · arXiv:2203.05140
-
Towards Generalized Models for Task-oriented Dialogue Modeling on Spoken Conversations 8 Mar 2022 · 0 repositories · arXiv:2203.04045
-
Pre-trained Token-replaced Detection Model as Few-shot Learner 7 Mar 2022 · 1 repository · arXiv:2203.03235
-
Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intents 6 Mar 2022 · 1 repository · arXiv:2203.02898
-
Graph Neural Network Enhanced Language Models for Efficient Multilingual Text Classification 6 Mar 2022 · 0 repositories · arXiv:2203.02912
-
Leveraging Pre-trained BERT for Audio Captioning 6 Mar 2022 · 0 repositories · arXiv:2203.02838
-
Detecting Offensive Language on Social Networks: An End-to-end Detection Method based on Graph Attention Networks 4 Mar 2022 · 0 repositories · arXiv:2203.02123
-
BoMD: Bag of Multi-label Descriptors for Noisy Chest X-ray Classification 3 Mar 2022 · 2 repositories · arXiv:2203.01937
-
Discontinuous Constituency and BERT: A Case Study of Dutch 2 Mar 2022 · 1 repository · arXiv:2203.01063
-
BERT-LID: Leveraging BERT to Improve Spoken Language Identification 1 Mar 2022 · 1 repository · arXiv:2203.00328
-
E-LANG: Energy-Based Joint Inferencing of Super and Swift Language Models 1 Mar 2022 · 0 repositories · arXiv:2203.00748
-
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction 1 Mar 2022 · 0 repositories · arXiv:2203.00286
-
The impact of lexical and grammatical processing on generating code from natural language 28 Feb 2022 · 2 repositories · arXiv:2202.13972
-
Enhancing Legal Argument Mining with Domain Pre-training and Neural Networks 27 Feb 2022 · 1 repository · arXiv:2202.13457
-
Bi-directional Joint Neural Networks for Intent Classification and Slot Filling 26 Feb 2022 · 0 repositories · arXiv:2202.13079
-
Multi-Level Contrastive Learning for Cross-Lingual Alignment 26 Feb 2022 · 0 repositories · arXiv:2202.13083
-
APEACH: Attacking Pejorative Expressions with Analysis on Crowd-Generated Hate Speech Evaluation Datasets 25 Feb 2022 · 1 repository · arXiv:2202.12459
-
BERTVision -- A Parameter-Efficient Approach for Question Answering 24 Feb 2022 · 1 repository · arXiv:2202.12210Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Finding Inverse Document Frequency Information in BERT 24 Feb 2022 · 0 repositories · arXiv:2202.12191
-
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words 24 Feb 2022 · 0 repositories · arXiv:2202.12142
-
Probing BERT's priors with serial reproduction chains 24 Feb 2022 · 1 repository · arXiv:2202.12226Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Sky Computing: Accelerating Geo-distributed Computing in Federated Learning 24 Feb 2022 · 1 repository · arXiv:2202.11836
-
TrimBERT: Tailoring BERT for Trade-offs 24 Feb 2022 · 0 repositories · arXiv:2202.12411
-
Using calibrator to improve robustness in Machine Reading Comprehension 24 Feb 2022 · 0 repositories · arXiv:2202.11865
-
Improving CTC-based speech recognition via knowledge transferring from pre-trained language models 22 Feb 2022 · 1 repository · arXiv:2203.03582
-
JAMES: Normalizing Job Titles with Multi-Aspect Graph Embeddings and Reasoning 22 Feb 2022 · 0 repositories · arXiv:2202.10739
-
Items from Psychometric Tests as Training Data for Personality Profiling Models of Twitter Users 21 Feb 2022 · 0 repositories · arXiv:2202.10415
-
Contextual Semantic Embeddings for Ontology Subsumption Prediction 20 Feb 2022 · 2 repositories · arXiv:2202.09791
-
Do Transformers know symbolic rules, and would we know if they did? 19 Feb 2022 · 0 repositories · arXiv:2203.00162
-
Evaluating the Construct Validity of Text Embeddings with Application to Survey Questions 18 Feb 2022 · 1 repository · arXiv:2202.09166
-
SGPT: GPT Sentence Embeddings for Semantic Search 17 Feb 2022 · 1 repository · arXiv:2202.08904Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing 17 Feb 2022 · 0 repositories · arXiv:2203.03550
-
A Survey of Pretraining on Graphs: Taxonomy, Methods, and Applications 16 Feb 2022 · 3 repositories · arXiv:2202.07893
-
No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices 16 Feb 2022 · 0 repositories · arXiv:2202.08036
-
The NLP Task Effectiveness of Long-Range Transformers 16 Feb 2022 · 0 repositories · arXiv:2202.07856
-
BLUE at Memotion 2.0 2022: You have my Image, my Text and my Transformer 15 Feb 2022 · 0 repositories · arXiv:2202.07543
-
One Configuration to Rule Them All? Towards Hyperparameter Transfer in Topic Models using Multi-Objective Bayesian Optimization 15 Feb 2022 · 1 repository · arXiv:2202.07631
-
Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation 15 Feb 2022 · 1 repository · arXiv:2202.07654
-
Toxic Comments Hunter : Score Severity of Toxic Comments 15 Feb 2022 · 0 repositories · arXiv:2203.03548
-
Punctuation restoration in Swedish through fine-tuned KB-BERT 14 Feb 2022 · 0 repositories · arXiv:2202.06769
-
UserBERT: Modeling Long- and Short-Term User Preferences via Self-Supervision 14 Feb 2022 · 0 repositories · arXiv:2202.07605
-
Assessment of contextualised representations in detecting outcome phrases in clinical trials 13 Feb 2022 · 0 repositories · arXiv:2203.03547
-
Automatic Issue Classifier: A Transfer Learning Framework for Classifying Issue Reports 12 Feb 2022 · 1 repository · arXiv:2202.06149
-
Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam 12 Feb 2022 · 1 repository · arXiv:2202.06009
-
White-Box Attacks on Hate-speech BERT Classifiers in German with Explicit and Implicit Character Level Defense 11 Feb 2022 · 1 repository · arXiv:2202.05778
-
A Multi-task Learning Framework for Product Ranking with BERT 10 Feb 2022 · 0 repositories · arXiv:2202.05317
-
Slovene SuperGLUE Benchmark: Translation and Evaluation 10 Feb 2022 · 0 repositories · arXiv:2202.04994
-
Can Open Domain Question Answering Systems Answer Visual Knowledge Questions? 9 Feb 2022 · 0 repositories · arXiv:2202.04306
-
Social Media as an Instant Source of Feedback on Water Quality 9 Feb 2022 · 0 repositories · arXiv:2202.04462
-
pNLP-Mixer: an Efficient all-MLP Architecture for Language 9 Feb 2022 · 1 repository · arXiv:2202.04350
-
Do Language Models Learn Position-Role Mappings? 8 Feb 2022 · 0 repositories · arXiv:2202.03611
-
HistBERT: A Pre-trained Language Model for Diachronic Lexical Semantic Analysis 8 Feb 2022 · 1 repository · arXiv:2202.03612
-
Logical Reasoning for Task Oriented Dialogue Systems 8 Feb 2022 · 0 repositories · arXiv:2202.04161
-
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework 7 Feb 2022 · 4 repositories · arXiv:2202.03052Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data 6 Feb 2022 · 1 repository · arXiv:2202.02842
-
Classification on Sentence Embeddings for Legal Assistance 5 Feb 2022 · 0 repositories · arXiv:2202.02639
-
StonkBERT: Can Language Models Predict Medium-Run Stock Price Movements? 4 Feb 2022 · 0 repositories · arXiv:2202.02268
-
Temporal Attention for Language Models 4 Feb 2022 · 1 repository · arXiv:2202.02093
-
ASR-Aware End-to-end Neural Diarization 2 Feb 2022 · 0 repositories · arXiv:2202.01286
-
GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records 2 Feb 2022 · 0 repositories · arXiv:2203.03540
-
RescoreBERT: Discriminative Speech Recognition Rescoring with BERT 2 Feb 2022 · 0 repositories · arXiv:2202.01094
-
Robust Training of Neural Networks Using Scale Invariant Architectures 2 Feb 2022 · 0 repositories · arXiv:2202.00980
-
An Adaptive Deep Clustering Pipeline to Inform Text Labeling at Scale 1 Feb 2022 · 0 repositories · arXiv:2202.01211
-
A Semi-Supervised Deep Clustering Pipeline for Mining Intentions From Texts 1 Feb 2022 · 0 repositories · arXiv:2202.00802
-
Improving BERT-based Query-by-Document Retrieval with Multi-Task Optimization 1 Feb 2022 · 0 repositories · arXiv:2202.00373
-
Regression Transformer: Concurrent sequence regression and generation for molecular language modeling 1 Feb 2022 · 1 repository · arXiv:2202.01338Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
-
Transformer-based Models of Text Normalization for Speech Applications 1 Feb 2022 · 0 repositories · arXiv:2202.00153