Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 62
Linear Warmup With Linear Decay
Papers archive 2025-07-28
archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)
Page 62 of 71: papers 6,101 to 6,200 of 7,076, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
"Judge me by my size (noun), do you?'' YodaLib: A Demographic-Aware Humor Generation Framework 31 May 2020 · 0 repositories · arXiv:2006.00578
-
LRG at SemEval-2020 Task 7: Assessing the Ability of BERT and Derivative Models to Perform Short-Edits based Humor Grading 31 May 2020 · 0 repositories · arXiv:2006.00607
-
Neural Entity Linking: A Survey of Models Based on Deep Learning 31 May 2020 · 0 repositories · arXiv:2006.00575
-
Detecting Problem Statements in Peer Assessments 30 May 2020 · 0 repositories · arXiv:2006.04532
-
A Comparative Study of Lexical Substitution Approaches based on Neural Language Models 29 May 2020 · 0 repositories · arXiv:2006.00031
-
SAFER: A Structure-free Approach for Certified Robustness to Adversarial Word Substitutions 29 May 2020 · 1 repository · arXiv:2005.14424Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Stance Prediction for Contemporary Issues: Data and Experiments 29 May 2020 · 1 repository · arXiv:2006.00052
-
Using Large Pretrained Language Models for Answering User Queries from Product Specifications 29 May 2020 · 0 repositories · arXiv:2005.14613
-
On Incorporating Structural Information to improve Dialogue Response Generation 28 May 2020 · 1 repository · arXiv:2005.14315
-
CausaLM: Causal Model Explanation Through Counterfactual Language Models 27 May 2020 · 1 repository · arXiv:2005.13407Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
A Quantitative Survey of Communication Optimizations in Distributed Deep Learning 27 May 2020 · 1 repository · arXiv:2005.13247
-
Language Representation Models for Fine-Grained Sentiment Classification 27 May 2020 · 1 repository · arXiv:2005.13619
-
Network-to-Network Translation with Conditional Invertible Neural Networks 27 May 2020 · 1 repository · arXiv:2005.13580
-
Syntactic Structure Distillation Pretraining For Bidirectional Encoders 27 May 2020 · 0 repositories · arXiv:2005.13482
-
Transition-based Semantic Dependency Parsing with Pointer Networks 27 May 2020 · 1 repository · arXiv:2005.13344
-
A Data-driven Approach for Noise Reduction in Distantly Supervised Biomedical Relation Extraction 26 May 2020 · 1 repository · arXiv:2005.12565
-
BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection 26 May 2020 · 1 repository · arXiv:2005.12503
-
BERT-XML: Large Scale Automated ICD Coding Using BERT Pretraining 26 May 2020 · 0 repositories · arXiv:2006.03685
-
Comparing BERT against traditional machine learning text classification 26 May 2020 · 0 repositories · arXiv:2005.13012
-
ParsBERT: Transformer-based Model for Persian Language Understanding 26 May 2020 · 3 repositories · arXiv:2005.12515
-
What Are People Asking About COVID-19? A Question Classification Dataset 26 May 2020 · 2 repositories · arXiv:2005.12522
-
An Audio-enriched BERT-based Framework for Spoken Multiple-choice Question Answering 25 May 2020 · 0 repositories · arXiv:2005.12142
-
Køpsala: Transition-Based Graph Parsing via Efficient Training and Effective Encoding 25 May 2020 · 1 repository · arXiv:2005.12094
-
Pointwise Paraphrase Appraisal is Potentially Problematic 25 May 2020 · 0 repositories · arXiv:2005.11996
-
Jointly Encoding Word Confusion Network and Dialogue Context with BERT for Spoken Language Understanding 24 May 2020 · 1 repository · arXiv:2005.11640
-
Comparative Study of Machine Learning Models and BERT on SQuAD 22 May 2020 · 1 repository · arXiv:2005.11313
-
L2R2: Leveraging Ranking for Abductive Reasoning 22 May 2020 · 1 repository · arXiv:2005.11223
-
Living Machines: A study of atypical animacy 22 May 2020 · 1 repository · arXiv:2005.11140
-
Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction 22 May 2020 · 1 repository · arXiv:2005.12833
-
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks 22 May 2020 · 18 repositories · arXiv:2005.11401Syntology 6 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Robust Layout-aware IE for Visually Rich Documents with Pre-trained Language Models 22 May 2020 · 0 repositories · arXiv:2005.11017
-
BERTweet: A pre-trained language model for English Tweets 20 May 2020 · 3 repositories · arXiv:2005.10200
-
FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval 20 May 2020 · 3 repositories · arXiv:2005.09801
-
Cross-lingual Approaches for Task-specific Dialogue Act Recognition 19 May 2020 · 0 repositories · arXiv:2005.09260
-
Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch Gestalt 19 May 2020 · 1 repository · arXiv:2005.09159
-
Table Search Using a Deep Contextualized Language Model 19 May 2020 · 1 repository · arXiv:2005.09207
-
Are All Languages Created Equal in Multilingual BERT? 18 May 2020 · 1 repository · arXiv:2005.09093
-
Yseop at SemEval-2020 Task 5: Cascaded BERT Language Model for Counterfactual Statement Analysis 18 May 2020 · 0 repositories · arXiv:2005.08519
-
Adversarial Training for Commonsense Inference 17 May 2020 · 1 repository · arXiv:2005.08156
-
Building a Hebrew Semantic Role Labeling Lexical Resource from Parallel Movie Subtitles 17 May 2020 · 1 repository · arXiv:2005.08206
-
Context-Based Quotation Recommendation 17 May 2020 · 0 repositories · arXiv:2005.08319
-
Cross-Lingual Low-Resource Set-to-Description Retrieval for Global E-Commerce 17 May 2020 · 1 repository · arXiv:2005.08188
-
Support-BERT: Predicting Quality of Question-Answer Pairs in MSDN using Deep Bidirectional Transformer 17 May 2020 · 0 repositories · arXiv:2005.08294
-
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data 17 May 2020 · 1 repository · arXiv:2005.08314
-
CERT: Contrastive Self-supervised Learning for Language Understanding 16 May 2020 · 0 repositories · arXiv:2005.12766
-
Leveraging Affective Bidirectional Transformers for Offensive Language Detection 16 May 2020 · 0 repositories · arXiv:2006.01266
-
Challenges in Emotion Style Transfer: An Exploration with a Lexical Substitution Pipeline 15 May 2020 · 1 repository · arXiv:2005.07617
-
Cross-lingual Transfer of Sentiment Classifiers 15 May 2020 · 0 repositories · arXiv:2005.07456
-
KEIS@JUST at SemEval-2020 Task 12: Identifying Multilingual Offensive Tweets Using Weighted Ensemble and Fine-Tuned BERT 15 May 2020 · 0 repositories · arXiv:2005.07820
-
Neural Entity Linking on Technical Service Tickets 15 May 2020 · 0 repositories · arXiv:2005.07604
-
Spelling Error Correction with Soft-Masked BERT 15 May 2020 · 5 repositories · arXiv:2005.07421Syntology 14 ran (of which 2 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 17 harvested samples) · 3 pointer-only (licence)
-
Pre-training technique to localize medical BERT and enhance biomedical BERT 14 May 2020 · 1 repository · arXiv:2005.07202
-
NIT-Agartala-NLP-Team at SemEval-2020 Task 8: Building Multimodal Classifiers to tackle Internet Humor 14 May 2020 · 0 repositories · arXiv:2005.06943
-
Entity-Enriched Neural Models for Clinical Question Answering 13 May 2020 · 2 repositories · arXiv:2005.06587
-
Parallel Corpus Filtering via Pre-trained Language Models 13 May 2020 · 0 repositories · arXiv:2005.06166
-
On the Robustness of Language Encoders against Grammatical Errors 12 May 2020 · 1 repository · arXiv:2005.05683Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis 12 May 2020 · 7 repositories · arXiv:2005.05635
-
Detecting Adverse Drug Reactions from Twitter through Domain-Specific Preprocessing and BERT Ensembling 11 May 2020 · 0 repositories · arXiv:2005.06634
-
How Context Affects Language Models' Factual Predictions 10 May 2020 · 0 repositories · arXiv:2005.04611
-
Transformer Based Language Models for Similar Text Retrieval and Ranking 10 May 2020 · 0 repositories · arXiv:2005.04588
-
Finding Universal Grammatical Relations in Multilingual BERT 9 May 2020 · 1 repository · arXiv:2005.04511Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations 9 May 2020 · 1 repository · arXiv:2005.04364
-
LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluation 9 May 2020 · 0 repositories · arXiv:2005.04322
-
schuBERT: Optimizing Elements of BERT 9 May 2020 · 0 repositories · arXiv:2005.06628
-
Comparative Analysis of Text Classification Approaches in Electronic Health Records 8 May 2020 · 0 repositories · arXiv:2005.06624
-
Distilling Knowledge from Pre-trained Language Models via Text Smoothing 8 May 2020 · 0 repositories · arXiv:2005.03848
-
GOBO: Quantizing Attention-Based NLP Models for Low Latency and Energy Efficient Inference 8 May 2020 · 0 repositories · arXiv:2005.03842
-
SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics 8 May 2020 · 2 repositories · arXiv:2005.04114
-
Temporal Common Sense Acquisition with Minimal Supervision 8 May 2020 · 0 repositories · arXiv:2005.04304
-
LIIR at SemEval-2020 Task 12: A Cross-Lingual Augmentation Approach for Multilingual Offensive Language Identification 7 May 2020 · 0 repositories · arXiv:2005.03695
-
An Empirical Study of Multi-Task Learning on BERT for Biomedical Text Mining 6 May 2020 · 1 repository · arXiv:2005.02799
-
Autoencoding Pixies: Amortised Variational Inference with Graph Convolutions for Functional Distributional Semantics 6 May 2020 · 1 repository · arXiv:2005.02991
-
Categorical Vector Space Semantics for Lambek Calculus with a Relevant Modality 6 May 2020 · 0 repositories · arXiv:2005.03074
-
Harvesting and Refining Question-Answer Pairs for Unsupervised QA 6 May 2020 · 1 repository · arXiv:2005.02925
-
Contextualizing Hate Speech Classifiers with Post-hoc Explanation 5 May 2020 · 3 repositories · arXiv:2005.02439Syntology official (archive's flag): 2 ran · 10 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 18 harvested samples) · 2 pointer-only (licence)
-
Establishing Baselines for Text Classification in Low-Resource Languages 5 May 2020 · 1 repository · arXiv:2005.02068
-
ExpBERT: Representation Engineering with Natural Language Explanations 5 May 2020 · 2 repositories · arXiv:2005.01932Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
ImpactCite: An XLNet-based method for Citation Impact Analysis 5 May 2020 · 1 repository · arXiv:2005.06611
-
MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models 5 May 2020 · 1 repository · arXiv:2005.02507
-
Code and Named Entity Recognition in StackOverflow 4 May 2020 · 2 repositories · arXiv:2005.01634Syntology official (archive's flag): 7 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples)
-
Robust Encodings: A Framework for Combating Adversarial Typos 4 May 2020 · 1 repository · arXiv:2005.01229
-
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words 4 May 2020 · 0 repositories · arXiv:2005.01810Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answering 4 May 2020 · 1 repository · arXiv:2005.01218
-
Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correction 3 May 2020 · 1 repository · arXiv:2005.00987
-
BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA 2 May 2020 · 1 repository · arXiv:2005.00766
-
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models 2 May 2020 · 0 repositories · arXiv:2005.00683
-
Contrastive Self-Supervised Learning for Commonsense Reasoning 2 May 2020 · 3 repositories · arXiv:2005.00669Syntology official (archive's flag): 3 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering 2 May 2020 · 1 repository · arXiv:2005.00697Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
DagoBERT: Generating Derivational Morphology with a Pretrained Language Model 2 May 2020 · 1 repository · arXiv:2005.00672
-
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization 2 May 2020 · 1 repository · arXiv:2005.02178
-
A Summarization Dataset of Slovak News Articles 1 May 2020 · 0 repositories
-
Abusive language in Spanish children and young teenager's conversations: data preparation and short text classification with contextual word embeddings 1 May 2020 · 0 repositories
-
Adaptation of Deep Bidirectional Transformers for Afrikaans Language 1 May 2020 · 0 repositories
-
Adapting BERT to Implicit Discourse Relation Classification with a Focus on Discourse Connectives 1 May 2020 · 0 repositories
-
Aggression and Misogyny Detection using BERT: A Multi-Task Approach 1 May 2020 · 1 repository
-
Aggression Identification in English, Hindi and Bangla Text using BERT, RoBERTa and SVM 1 May 2020 · 1 repository
-
Aggression Identification in Social Media: a Transfer Learning Based Approach 1 May 2020 · 0 repositories
-
AIA-BDE: A Corpus of FAQs in Portuguese and their Variations 1 May 2020 · 0 repositories
-
An Evaluation Dataset for Identifying Communicative Functions of Sentences in English Scholarly Papers 1 May 2020 · 0 repositories
-
Analyzing ELMo and DistilBERT on Socio-political News Classification 1 May 2020 · 0 repositories