Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 64
Linear Warmup With Linear Decay
Papers archive 2025-07-28
archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)
Page 64 of 71: papers 6,301 to 6,400 of 7,076, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Learning to Classify Intents and Slot Labels Given a Handful of Examples 22 Apr 2020 · 0 repositories · arXiv:2004.10793
-
Residual Energy-Based Models for Text Generation 22 Apr 2020 · 1 repository · arXiv:2004.11714
-
Attention is Not Only a Weight: Analyzing Transformers with Vector Norms 21 Apr 2020 · 1 repository · arXiv:2004.10102Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
BERT-ATTACK: Adversarial Attack Against BERT Using BERT 21 Apr 2020 · 4 repositories · arXiv:2004.09984Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
DIET: Lightweight Language Understanding for Dialogue Systems 21 Apr 2020 · 2 repositories · arXiv:2004.09936Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
-
Domain-Guided Task Decomposition with Self-Training for Detecting Personal Events in Social Media 21 Apr 2020 · 0 repositories · arXiv:2004.10201
-
Investigating the Effectiveness of Representations Based on Pretrained Transformer-based Language Models in Active Learning for Labelling Text Datasets 21 Apr 2020 · 0 repositories · arXiv:2004.13138
-
A Study of Cross-Lingual Ability and Language-specific Information in Multilingual BERT 20 Apr 2020 · 0 repositories · arXiv:2004.09205
-
Adversarial Training for Large Neural Language Models 20 Apr 2020 · 3 repositories · arXiv:2004.08994
-
CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERT 20 Apr 2020 · 7 repositories · arXiv:2004.09167Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples) · 3 pointer-only (licence)
-
MPNet: Masked and Permuted Pre-training for Language Understanding 20 Apr 2020 · 7 repositories · arXiv:2004.09297Syntology official (archive's flag): 2 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 6 pointer-only (licence)
-
StereoSet: Measuring stereotypical bias in pretrained language models 20 Apr 2020 · 3 repositories · arXiv:2004.09456
-
Enhancing Pharmacovigilance with Drug Reviews and Social Media 18 Apr 2020 · 1 repository · arXiv:2004.08731
-
Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning 17 Apr 2020 · 1 repository · arXiv:2004.08097Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Learning-to-Rank with BERT in TF-Ranking 17 Apr 2020 · 0 repositories · arXiv:2004.08476
-
Too Many Claims to Fact-Check: Prioritizing Political Claims Based on Check-Worthiness 17 Apr 2020 · 0 repositories · arXiv:2004.08166
-
Cross-lingual Contextualized Topic Models with Zero-shot Learning 16 Apr 2020 · 2 repositories · arXiv:2004.07737Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
The Right Tool for the Job: Matching Model and Instance Complexities 16 Apr 2020 · 1 repository · arXiv:2004.07453Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
Coreferential Reasoning Learning for Language Representation 15 Apr 2020 · 2 repositories · arXiv:2004.06870
-
SPECTER: Document-level Representation Learning using Citation-informed Transformers 15 Apr 2020 · 5 repositories · arXiv:2004.07180Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Entities as Experts: Sparse Memory Access with Entity Supervision 15 Apr 2020 · 1 repository · arXiv:2004.07202Syntology 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 14 pointer-only (licence)
-
lamBERT: Language and Action Learning Using Multimodal BERT 15 Apr 2020 · 0 repositories · arXiv:2004.07093
-
Sentiment Analysis of Yelp Reviews: A Comparison of Techniques and Models 15 Apr 2020 · 1 repository · arXiv:2004.13851
-
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue 15 Apr 2020 · 1 repository · arXiv:2004.06871Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified (of 13 harvested samples) · 13 pointer-only (licence)
-
Training with Quantization Noise for Extreme Model Compression 15 Apr 2020 · 4 repositories · arXiv:2004.07320
-
A Simple Yet Strong Pipeline for HotpotQA 14 Apr 2020 · 0 repositories · arXiv:2004.06753
-
Deep Learning Models for Multilingual Hate Speech Detection 14 Apr 2020 · 3 repositories · arXiv:2004.06465
-
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation 14 Apr 2020 · 2 repositories · arXiv:2004.07159
-
CrisisBench: Benchmarking Crisis-related Social Media Datasets for Humanitarian Information Processing 14 Apr 2020 · 0 repositories · arXiv:2004.06774
-
What's so special about BERT's layers? A closer look at the NLP pipeline in monolingual and multilingual models 14 Apr 2020 · 2 repositories · arXiv:2004.06499Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Cascade Neural Ensemble for Identifying Scientifically Sound Articles 13 Apr 2020 · 0 repositories · arXiv:2004.06222
-
Improving Scholarly Knowledge Representation: Evaluating BERT-based Models for Scientific Relation Classification 13 Apr 2020 · 0 repositories · arXiv:2004.06153
-
Pretrained Transformers Improve Out-of-Distribution Robustness 13 Apr 2020 · 1 repository · arXiv:2004.06100
-
ProFormer: Towards On-Device LSH Projection Based Transformers 13 Apr 2020 · 0 repositories · arXiv:2004.05801
-
Robustly Pre-trained Neural Model for Direct Temporal Relation Extraction 13 Apr 2020 · 0 repositories · arXiv:2004.06216
-
Unified Multi-Criteria Chinese Word Segmentation with BERT 13 Apr 2020 · 0 repositories · arXiv:2004.05808
-
AMR Parsing via Graph-Sequence Iterative Inference 12 Apr 2020 · 3 repositories · arXiv:2004.05572Syntology official (archive's flag): 4 ran · 21 ran (of which 11 constructed an object rather than computing a result; 16 with no instrument failure: 1 honoured, 1 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 10 unverified (of 31 harvested samples) · 1 pointer-only (licence)
-
Pre-training Text Representations as Meta Learning 12 Apr 2020 · 0 repositories · arXiv:2004.05568
-
VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification 12 Apr 2020 · 1 repository · arXiv:2004.05707Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
End to End Chinese Lexical Fusion Recognition with Sememe Knowledge 11 Apr 2020 · 0 repositories · arXiv:2004.05456
-
LAReQA: Language-agnostic answer retrieval from a multilingual pool 11 Apr 2020 · 1 repository · arXiv:2004.05484
-
An In-depth Walkthrough on Evolution of Neural Machine Translation 10 Apr 2020 · 0 repositories · arXiv:2004.04902
-
Longformer: The Long-Document Transformer 10 Apr 2020 · 22 repositories · arXiv:2004.05150Syntology official (archive's flag): 9 ran · 22 ran (of which 4 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 1 violated, 12 with no contract checked; 8 where Syntology's instrument failed) · 13 unverified (of 35 harvested samples) · 5 pointer-only (licence)
-
Beyond Fine-tuning: Few-Sample Sentence Embedding Transfer 10 Apr 2020 · 0 repositories · arXiv:2004.05119
-
Telling BERT's full story: from Local Attention to Global Aggregation 10 Apr 2020 · 0 repositories · arXiv:2004.05916
-
BLEURT: Learning Robust Metrics for Text Generation 9 Apr 2020 · 4 repositories · arXiv:2004.04696Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Interpretability Analysis for Named Entity Recognition to Understand System Predictions and How They Can Improve 9 Apr 2020 · 0 repositories · arXiv:2004.04564
-
On the Language Neutrality of Pre-trained Multilingual Representations 9 Apr 2020 · 1 repository · arXiv:2004.05160Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement 8 Apr 2020 · 1 repository · arXiv:2004.03760
-
DynaBERT: Dynamic BERT with Adaptive Width and Depth 8 Apr 2020 · 3 repositories · arXiv:2004.04037Syntology official (archive's flag): 5 ran · 5 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Error correction and extraction in request dialogs 8 Apr 2020 · 0 repositories · arXiv:2004.04243
-
Analyzing Redundancy in Pretrained Transformer Models 8 Apr 2020 · 1 repository · arXiv:2004.04010
-
Improving BERT with Self-Supervised Attention 8 Apr 2020 · 1 repository · arXiv:2004.03808
-
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression 8 Apr 2020 · 0 repositories · arXiv:2004.04124
-
On the Effect of Dropping Layers of Pre-trained Transformer Models 8 Apr 2020 · 4 repositories · arXiv:2004.03844Syntology official (archive's flag): 5 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherence 8 Apr 2020 · 3 repositories · arXiv:2004.03974Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
SciWING -- A Software Toolkit for Scientific Document Processing 8 Apr 2020 · 1 repository · arXiv:2004.03807
-
Severing the Edge Between Before and After: Neural Architectures for Temporal Ordering of Events 8 Apr 2020 · 0 repositories · arXiv:2004.04295
-
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition 7 Apr 2020 · 1 repository · arXiv:2004.03066Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Information-Theoretic Probing for Linguistic Structure 7 Apr 2020 · 1 repository · arXiv:2004.03061Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots 7 Apr 2020 · 2 repositories · arXiv:2004.03588
-
TextGAIL: Generative Adversarial Imitation Learning for Text Generation 7 Apr 2020 · 0 repositories · arXiv:2004.13796
-
The Russian Drug Reaction Corpus and Neural Models for Drug Reactions and Effectiveness Detection in User Reviews 7 Apr 2020 · 1 repository · arXiv:2004.03659
-
Towards Evaluating the Robustness of Chinese BERT Classifiers 7 Apr 2020 · 0 repositories · arXiv:2004.03742
-
Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation 7 Apr 2020 · 0 repositories · arXiv:2004.03097
-
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-based Question Answering 7 Apr 2020 · 1 repository · arXiv:2004.03561
-
Bootstrapping a Crosslingual Semantic Parser 6 Apr 2020 · 1 repository · arXiv:2004.02585
-
Enhancing Review Comprehension with Domain-Specific Commonsense 6 Apr 2020 · 0 repositories · arXiv:2004.03020
-
Leveraging the Inherent Hierarchy of Vacancy Titles for Automated Job Ontology Expansion 6 Apr 2020 · 0 repositories · arXiv:2004.02814
-
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices 6 Apr 2020 · 7 repositories · arXiv:2004.02984
-
FastBERT: a Self-distilling BERT with Adaptive Inference Time 5 Apr 2020 · 3 repositories · arXiv:2004.02178Syntology community repositories only · 6 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
Continual Domain-Tuning for Pretrained Language Models 5 Apr 2020 · 0 repositories · arXiv:2004.02288
-
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space 5 Apr 2020 · 1 repository · arXiv:2004.04092
-
A Dependency Syntactic Knowledge Augmented Interactive Architecture for End-to-End Aspect-based Sentiment Analysis 4 Apr 2020 · 3 repositories · arXiv:2004.01951
-
CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection 4 Apr 2020 · 0 repositories · arXiv:2004.01881
-
Finding Black Cat in a Coal Cellar -- Keyphrase Extraction & Keyphrase-Rubric Relationship Classification from Complex Assignments 3 Apr 2020 · 2 repositories · arXiv:2004.01549
-
Testing pre-trained Transformer models for Lithuanian news clustering 3 Apr 2020 · 0 repositories · arXiv:2004.03461
-
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation 3 Apr 2020 · 2 repositories · arXiv:2004.01401
-
Gestalt: a Stacking Ensemble for SQuAD2.0 2 Apr 2020 · 0 repositories · arXiv:2004.07067
-
Deep Entity Matching with Pre-Trained Language Models 1 Apr 2020 · 1 repository · arXiv:2004.00584Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Give your Text Representation Models some Love: the Case for Basque 31 Mar 2020 · 1 repository · arXiv:2004.00033
-
Towards Productionizing Subjective Search Systems 31 Mar 2020 · 0 repositories · arXiv:2003.13968
-
Unification-based Reconstruction of Multi-hop Explanations for Science Questions 31 Mar 2020 · 1 repository · arXiv:2004.00061
-
InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining 30 Mar 2020 · 0 repositories · arXiv:2003.13198
-
NukeBERT: A Pre-trained language model for Low Resource Nuclear Domain 30 Mar 2020 · 1 repository · arXiv:2003.13821
-
Abstractive Text Summarization based on Language Model Conditioning and Locality Modeling 29 Mar 2020 · 1 repository · arXiv:2003.13027Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
BERT Fine-tuning For Arabic Text Summarization 29 Mar 2020 · 1 repository · arXiv:2004.14135Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 5 pointer-only (licence)
-
Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining 29 Mar 2020 · 2 repositories · arXiv:2003.13003
-
Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement 29 Mar 2020 · 1 repository · arXiv:2003.13118
-
Noisy Text Data: Achilles' Heel of BERT 29 Mar 2020 · 0 repositories · arXiv:2003.12932
-
HIN: Hierarchical Inference Network for Document-Level Relation Extraction 28 Mar 2020 · 0 repositories · arXiv:2003.12754
-
Cycle Text-To-Image GAN with BERT 26 Mar 2020 · 4 repositories · arXiv:2003.12137
-
Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection 26 Mar 2020 · 1 repository · arXiv:2003.11818
-
GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet 25 Mar 2020 · 0 repositories · arXiv:2003.11236
-
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators 23 Mar 2020 · 19 repositories · arXiv:2003.10555Syntology official: no sample here; runs from other or unrecorded repositories · 31 ran (of which 7 constructed an object rather than computing a result; 18 with no instrument failure: 2 honoured, 2 violated, 14 with no contract checked; 13 where Syntology's instrument failed) · 9 unverified (of 40 harvested samples) · 10 pointer-only (licence)
-
Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articles 22 Mar 2020 · 4 repositories · arXiv:2003.09881
-
Beheshti-NER: Persian Named Entity Recognition Using BERT 19 Mar 2020 · 3 repositories · arXiv:2003.08875
-
Diversity, Density, and Homogeneity: Quantitative Characteristic Metrics for Text Collections 19 Mar 2020 · 0 repositories · arXiv:2003.08529
-
Temporal Embeddings and Transformer Models for Narrative Text Understanding 19 Mar 2020 · 0 repositories · arXiv:2003.08811
-
The value of text for small business default prediction: A deep learning approach 19 Mar 2020 · 0 repositories · arXiv:2003.08964