Methods › General › Learning Rate Schedules › Linear Warmup With Cosine Annealing › Papers, page 37
Linear Warmup With Cosine Annealing
Papers archive 2025-07-28
archive papers tagged: 3,797 · with a code link: 1,655 · where Syntology ran a sample: 602 (490 with a run with no instrument failure, 112 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (602 of 3,797 tagged: 490 with a run with no instrument failure, 112 where every run was a failure of Syntology's instrument)
Page 37 of 38: papers 3,601 to 3,700 of 3,797, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Memformer: A Memory-Augmented Transformer for Sequence Modeling 14 Oct 2020 · 0 repositories · arXiv:2010.06891
-
The workweek is the best time to start a family -- A Study of GPT-2 Based Claim Generation 13 Oct 2020 · 0 repositories · arXiv:2010.06185
-
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs 12 Oct 2020 · 3 repositories · arXiv:2010.05953Syntology official (archive's flag): 1 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
Meta-Context Transformers for Domain-Specific Response Generation 12 Oct 2020 · 1 repository · arXiv:2010.05572
-
Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU 11 Oct 2020 · 1 repository · arXiv:2010.05330
-
Investigating African-American Vernacular English in Transformer-Based Text Generation 6 Oct 2020 · 1 repository · arXiv:2010.02510
-
Scene Graph Modification Based on Natural Language Commands 6 Oct 2020 · 1 repository · arXiv:2010.02591
-
GenAug: Data Augmentation for Finetuning Text Generators 5 Oct 2020 · 2 repositories · arXiv:2010.01794
-
Inquisitive Question Generation for High Level Text Comprehension 4 Oct 2020 · 1 repository · arXiv:2010.01657
-
Examining the rhetorical capacities of neural language models 1 Oct 2020 · 0 repositories · arXiv:2010.00153
-
The design and implementation of Language Learning Chatbot with XAI using Ontology and Transfer Learning 29 Sep 2020 · 0 repositories · arXiv:2009.13984
-
Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions 29 Sep 2020 · 1 repository · arXiv:2009.14259Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Toward a Thermodynamics of Meaning 24 Sep 2020 · 1 repository · arXiv:2009.11963
-
On Data Augmentation for Extreme Multi-label Classification 22 Sep 2020 · 0 repositories · arXiv:2009.10778
-
Prior Art Search and Reranking for Generated Patent Text 19 Sep 2020 · 0 repositories · arXiv:2009.09132
-
Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models 18 Sep 2020 · 0 repositories · arXiv:2009.08636
-
Critical Thinking for Language Models 15 Sep 2020 · 1 repository · arXiv:2009.07185Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Dialogue Response Ranking Training with Large-Scale Human Feedback Data 15 Sep 2020 · 2 repositories · arXiv:2009.06978Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners 15 Sep 2020 · 5 repositories · arXiv:2009.07118
-
The Radicalization Risks of GPT-3 and Advanced Neural Language Models 15 Sep 2020 · 0 repositories · arXiv:2009.06807
-
GeDi: Generative Discriminator Guided Sequence Generation 14 Sep 2020 · 3 repositories · arXiv:2009.06367Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding 13 Sep 2020 · 0 repositories · arXiv:2009.06097
-
Unit Test Case Generation with Transformers and Focal Context 11 Sep 2020 · 1 repository · arXiv:2009.05617
-
Brain2Word: Decoding Brain Activity for Language Generation 10 Sep 2020 · 1 repository · arXiv:2009.04765
-
Modern Methods for Text Generation 10 Sep 2020 · 2 repositories · arXiv:2009.04968
-
Sparsifying Transformer Models with Trainable Representation Pooling 10 Sep 2020 · 1 repository · arXiv:2009.05169
-
Pay Attention when Required 9 Sep 2020 · 2 repositories · arXiv:2009.04534
-
Black Box to White Box: Discover Model Characteristics Based on Strategic Probing 7 Sep 2020 · 0 repositories · arXiv:2009.03136
-
Improving Language Generation with Sentence Coherence Objective 7 Sep 2020 · 1 repository · arXiv:2009.06358
-
Measuring Massive Multitask Language Understanding 7 Sep 2020 · 18 repositories · arXiv:2009.03300Syntology community repositories only · 19 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 0 violated, 15 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 26 harvested samples) · 1 pointer-only (licence)
-
Comparative Evaluation of Pretrained Transfer Learning Models on Automatic Short Answer Grading 2 Sep 2020 · 1 repository · arXiv:2009.01303
-
Knowledge Efficient Deep Learning for Natural Language Processing 28 Aug 2020 · 0 repositories · arXiv:2008.12878
-
DAVE: Deriving Automatically Verilog from English 27 Aug 2020 · 0 repositories · arXiv:2009.01026
-
Discrete Word Embedding for Logical Natural Language Understanding 26 Aug 2020 · 0 repositories · arXiv:2008.11649
-
ETC-NLG: End-to-end Topic-Conditioned Natural Language Generation 25 Aug 2020 · 1 repository · arXiv:2008.10875
-
Dynamics of feed forward induced interference training 24 Aug 2020 · 0 repositories · arXiv:2008.11111
-
Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study 17 Aug 2020 · 0 repositories · arXiv:2008.13533
-
Narrative Interpolation for Generating and Understanding Stories 17 Aug 2020 · 0 repositories · arXiv:2008.07466
-
Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size 16 Aug 2020 · 0 repositories · arXiv:2008.07027
-
Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems 14 Aug 2020 · 0 repositories · arXiv:2008.06239
-
Navigating Human Language Models with Synthetic Agents 10 Aug 2020 · 0 repositories · arXiv:2008.04162
-
The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measures 4 Aug 2020 · 2 repositories · arXiv:2008.01307Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples)
-
Multi-node Bert-pretraining: Cost-efficient Approach 1 Aug 2020 · 0 repositories · arXiv:2008.00177
-
Trojaning Language Models for Fun and Profit 1 Aug 2020 · 1 repository · arXiv:2008.00312
-
Language Modelling for Source Code with Transformer-XL 31 Jul 2020 · 1 repository · arXiv:2007.15813
-
TweepFake: about Detecting Deepfake Tweets 31 Jul 2020 · 1 repository · arXiv:2008.00036
-
Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining 29 Jul 2020 · 1 repository · arXiv:2007.14587
-
Generative Pretraining from Pixels 17 Jul 2020 · 4 repositories
-
Deep Transformer based Data Augmentation with Subword Units for Morphologically Rich Online ASR 14 Jul 2020 · 0 repositories · arXiv:2007.06949
-
Do Transformers Need Deep Long-Range Memory 7 Jul 2020 · 1 repository · arXiv:2007.03356
-
The Go Transformer: Natural Language Modeling for Game Play 7 Jul 2020 · 0 repositories · arXiv:2007.03500
-
You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion 5 Jul 2020 · 0 repositories · arXiv:2007.02220
-
On-The-Fly Information Retrieval Augmentation for Language Models 3 Jul 2020 · 0 repositories · arXiv:2007.01528
-
Do Transformers Need Deep Long-Range Memory? 1 Jul 2020 · 0 repositories
-
LSTM and GPT-2 Synthetic Speech Transfer Learning for Speaker Recognition to Overcome Data Scarcity 1 Jul 2020 · 0 repositories · arXiv:2007.00659
-
Probing for Referential Information in Language Models 1 Jul 2020 · 0 repositories
-
Roles and Utilization of Attention Heads in Transformer-based Neural Language Models 1 Jul 2020 · 1 repository
-
Towards Holistic and Automatic Evaluation of Open-Domain Dialogue Generation 1 Jul 2020 · 1 repository
-
Knowledge-Aware Language Model Pretraining 29 Jun 2020 · 0 repositories · arXiv:2007.00655
-
Progressive Generation of Long Text with Pretrained Language Models 28 Jun 2020 · 1 repository · arXiv:2006.15720Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization 27 Jun 2020 · 0 repositories · arXiv:2006.15435
-
Video-Grounded Dialogues with Pretrained Generation Language Models 27 Jun 2020 · 0 repositories · arXiv:2006.15319
-
A Qualitative Evaluation of Language Models on Automatic Question-Answering for COVID-19 19 Jun 2020 · 1 repository · arXiv:2006.10964
-
Memory-Efficient Pipeline-Parallel DNN Training 16 Jun 2020 · 1 repository · arXiv:2006.09503Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 10 harvested samples)
-
Few-Shot Generative Conversational Query Rewriting 9 Jun 2020 · 1 repository · arXiv:2006.05009Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Unsupervised Paraphrase Generation using Pre-trained Language Models 9 Jun 2020 · 0 repositories · arXiv:2006.05477
-
GMAT: Global Memory Augmentation for Transformers 5 Jun 2020 · 1 repository · arXiv:2006.03274
-
Automatic Text Summarization of COVID-19 Medical Research Articles using BERT and GPT-2 3 Jun 2020 · 1 repository · arXiv:2006.01997
-
Emergence of Separable Manifolds in Deep Language Representations 1 Jun 2020 · 1 repository · arXiv:2006.01095
-
First Neural Conjecturing Datasets and Experiments 29 May 2020 · 0 repositories · arXiv:2005.14664
-
Language Models are Few-Shot Learners 28 May 2020 · 67 repositories · arXiv:2005.14165Syntology community repositories only · 45 ran (of which 0 constructed an object rather than computing a result; 40 with no instrument failure: 2 honoured, 1 violated, 37 with no contract checked; 5 where Syntology's instrument failed) · 20 unverified (of 65 harvested samples) · 7 pointer-only (licence)
-
Artificial Intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetry 20 May 2020 · 1 repository · arXiv:2005.09980
-
Exploring Transformers for Large-Scale Speech Recognition 19 May 2020 · 0 repositories · arXiv:2005.09684
-
Large Scale Multi-Actor Generative Dialog Modeling 13 May 2020 · 0 repositories · arXiv:2005.06114
-
On the Generation of Medical Dialogues for COVID-19 11 May 2020 · 0 repositories · arXiv:2005.05442
-
Distributional Discrepancy: A Metric for Unconditional Text Generation 4 May 2020 · 1 repository · arXiv:2005.01282
-
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words 4 May 2020 · 0 repositories · arXiv:2005.01810Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Simplifying Paragraph-level Question Generation via Transformer Language Models 3 May 2020 · 4 repositories · arXiv:2005.01107Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
A Simple Language Model for Task-Oriented Dialogue 2 May 2020 · 1 repository · arXiv:2005.00796Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 1 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples)
-
A Controllable Model of Grounded Response Generation 1 May 2020 · 1 repository · arXiv:2005.00613
-
Evaluation Metrics for Headline Generation Using Deep Pre-Trained Embeddings 1 May 2020 · 0 repositories
-
Improving Neural Language Generation with Spectrum Control 1 May 2020 · 0 repositories
-
Multilingual Corpus Creation for Multilingual Semantic Similarity Task 1 May 2020 · 0 repositories
-
POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training 1 May 2020 · 1 repository · arXiv:2005.00558Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 18 harvested samples) · 1 pointer-only (licence)
-
PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking 30 Apr 2020 · 2 repositories · arXiv:2004.14967Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples)
-
Segatron: Segment-Aware Transformer for Language Modeling and Understanding 30 Apr 2020 · 1 repository · arXiv:2004.14996
-
GePpeTto Carves Italian into a Language Model 29 Apr 2020 · 1 repository · arXiv:2004.14253
-
LightPAFF: A Two-Stage Distillation Framework for Pre-training and Fine-tuning 27 Apr 2020 · 0 repositories · arXiv:2004.12817
-
Assessing Discourse Relations in Language Generation from GPT-2 26 Apr 2020 · 0 repositories · arXiv:2004.12506
-
A Tailored Pre-Training Model for Task-Oriented Dialog Generation 24 Apr 2020 · 1 repository · arXiv:2004.13835
-
Mirror Ritual: An Affective Interface for Emotional Self-Reflection 21 Apr 2020 · 0 repositories · arXiv:2004.09685
-
StereoSet: Measuring stereotypical bias in pretrained language models 20 Apr 2020 · 3 repositories · arXiv:2004.09456
-
ResNeSt: Split-Attention Networks 19 Apr 2020 · 36 repositories · arXiv:2004.08955Syntology official (archive's flag): 5 ran · 28 ran (of which 0 constructed an object rather than computing a result; 25 with no instrument failure: 0 honoured, 0 violated, 25 with no contract checked; 3 where Syntology's instrument failed) · 20 unverified (of 48 harvested samples) · 23 pointer-only (licence)
-
Generating Counter Narratives against Online Hate Speech: Data and Strategies 8 Apr 2020 · 0 repositories · arXiv:2004.04216
-
Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic Fidelity 8 Apr 2020 · 1 repository · arXiv:2004.06577
-
TextGAIL: Generative Adversarial Imitation Learning for Text Generation 7 Apr 2020 · 0 repositories · arXiv:2004.13796
-
DARE: Data Augmented Relation Extraction with GPT-2 6 Apr 2020 · 0 repositories · arXiv:2004.13845
-
Sparse Text Generation 6 Apr 2020 · 1 repository · arXiv:2004.02644
-
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space 5 Apr 2020 · 1 repository · arXiv:2004.04092
-
Generating Rationales in Visual Question Answering 4 Apr 2020 · 0 repositories · arXiv:2004.02032