Methods › General › Learning Rate Schedules › Cosine Annealing › Papers, page 39

Cosine Annealing

Papers archive 2025-07-28

archive papers tagged: 3,965 · with a code link: 1,734 · where Syntology ran a sample: 627 (513 with a run with no instrument failure, 114 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (627 of 3,965 tagged: 513 with a run with no instrument failure, 114 where every run was a failure of Syntology's instrument)

Page 39 of 40: papers 3,801 to 3,900 of 3,965, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Memory-Efficient Pipeline-Parallel DNN Training
  16 Jun 2020 · 1 repository · arXiv:2006.09503
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 10 harvested samples)
• Few-Shot Generative Conversational Query Rewriting
  9 Jun 2020 · 1 repository · arXiv:2006.05009
  Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Unsupervised Paraphrase Generation using Pre-trained Language Models
  9 Jun 2020 · 0 repositories · arXiv:2006.05477
• GMAT: Global Memory Augmentation for Transformers
  5 Jun 2020 · 1 repository · arXiv:2006.03274
• Automatic Text Summarization of COVID-19 Medical Research Articles using BERT and GPT-2
  3 Jun 2020 · 1 repository · arXiv:2006.01997
• Emergence of Separable Manifolds in Deep Language Representations
  1 Jun 2020 · 1 repository · arXiv:2006.01095
• First Neural Conjecturing Datasets and Experiments
  29 May 2020 · 0 repositories · arXiv:2005.14664
• Language Models are Few-Shot Learners
  28 May 2020 · 67 repositories · arXiv:2005.14165
  Syntology community repositories only · 45 ran (of which 0 constructed an object rather than computing a result; 40 with no instrument failure: 2 honoured, 1 violated, 37 with no contract checked; 5 where Syntology's instrument failed) · 20 unverified (of 65 harvested samples) · 7 pointer-only (licence)
• Artificial Intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetry
  20 May 2020 · 1 repository · arXiv:2005.09980
• Exploring Transformers for Large-Scale Speech Recognition
  19 May 2020 · 0 repositories · arXiv:2005.09684
• Large Scale Multi-Actor Generative Dialog Modeling
  13 May 2020 · 0 repositories · arXiv:2005.06114
• A New Deep Neural Architecture Search Pipeline for Face Recognition
  12 May 2020 · 0 repositories
• On the Generation of Medical Dialogues for COVID-19
  11 May 2020 · 0 repositories · arXiv:2005.05442
• Distributional Discrepancy: A Metric for Unconditional Text Generation
  4 May 2020 · 1 repository · arXiv:2005.01282
• Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words
  4 May 2020 · 0 repositories · arXiv:2005.01810
  Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• Simplifying Paragraph-level Question Generation via Transformer Language Models
  3 May 2020 · 4 repositories · arXiv:2005.01107
  Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 1 pointer-only (licence)
• A Simple Language Model for Task-Oriented Dialogue
  2 May 2020 · 1 repository · arXiv:2005.00796
  Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 1 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples)
• A Controllable Model of Grounded Response Generation
  1 May 2020 · 1 repository · arXiv:2005.00613
• Evaluation Metrics for Headline Generation Using Deep Pre-Trained Embeddings
  1 May 2020 · 0 repositories
• Improving Neural Language Generation with Spectrum Control
  1 May 2020 · 0 repositories
• Multilingual Corpus Creation for Multilingual Semantic Similarity Task
  1 May 2020 · 0 repositories
• POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training
  1 May 2020 · 1 repository · arXiv:2005.00558
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 18 harvested samples) · 1 pointer-only (licence)
• PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking
  30 Apr 2020 · 2 repositories · arXiv:2004.14967
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples)
• Segatron: Segment-Aware Transformer for Language Modeling and Understanding
  30 Apr 2020 · 1 repository · arXiv:2004.14996
• GePpeTto Carves Italian into a Language Model
  29 Apr 2020 · 1 repository · arXiv:2004.14253
• LightPAFF: A Two-Stage Distillation Framework for Pre-training and Fine-tuning
  27 Apr 2020 · 0 repositories · arXiv:2004.12817
• Assessing Discourse Relations in Language Generation from GPT-2
  26 Apr 2020 · 0 repositories · arXiv:2004.12506
• A Tailored Pre-Training Model for Task-Oriented Dialog Generation
  24 Apr 2020 · 1 repository · arXiv:2004.13835
• Ultra Fast Structure-aware Deep Lane Detection
  24 Apr 2020 · 10 repositories · arXiv:2004.11757
  Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Supervised Contrastive Learning
  23 Apr 2020 · 26 repositories · arXiv:2004.11362
  Syntology community repositories only · 17 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 2 honoured, 0 violated, 12 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 23 harvested samples) · 5 pointer-only (licence)
• YOLOv4: Optimal Speed and Accuracy of Object Detection
  23 Apr 2020 · 223 repositories · arXiv:2004.10934
  Syntology community repositories only · 142 ran (of which 0 constructed an object rather than computing a result; 133 with no instrument failure: 6 honoured, 0 violated, 127 with no contract checked; 9 where Syntology's instrument failed) · 42 unverified (of 184 harvested samples) · 21 pointer-only (licence)
• Mirror Ritual: An Affective Interface for Emotional Self-Reflection
  21 Apr 2020 · 0 repositories · arXiv:2004.09685
• StereoSet: Measuring stereotypical bias in pretrained language models
  20 Apr 2020 · 3 repositories · arXiv:2004.09456
• ResNeSt: Split-Attention Networks
  19 Apr 2020 · 36 repositories · arXiv:2004.08955
  Syntology official (archive's flag): 5 ran · 28 ran (of which 0 constructed an object rather than computing a result; 25 with no instrument failure: 0 honoured, 0 violated, 25 with no contract checked; 3 where Syntology's instrument failed) · 20 unverified (of 48 harvested samples) · 23 pointer-only (licence)
• Generating Counter Narratives against Online Hate Speech: Data and Strategies
  8 Apr 2020 · 0 repositories · arXiv:2004.04216
• Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic Fidelity
  8 Apr 2020 · 1 repository · arXiv:2004.06577
• TextGAIL: Generative Adversarial Imitation Learning for Text Generation
  7 Apr 2020 · 0 repositories · arXiv:2004.13796
• DARE: Data Augmented Relation Extraction with GPT-2
  6 Apr 2020 · 0 repositories · arXiv:2004.13845
• Sparse Text Generation
  6 Apr 2020 · 1 repository · arXiv:2004.02644
• Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space
  5 Apr 2020 · 1 repository · arXiv:2004.04092
• Generating Rationales in Visual Question Answering
  4 Apr 2020 · 0 repositories · arXiv:2004.02032
• Designing Network Design Spaces
  30 Mar 2020 · 26 repositories · arXiv:2003.13678
  Syntology community repositories only · 48 ran (of which 0 constructed an object rather than computing a result; 41 with no instrument failure: 4 honoured, 0 violated, 37 with no contract checked; 7 where Syntology's instrument failed) · 5 unverified (of 53 harvested samples) · 7 pointer-only (licence)
• Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection
  26 Mar 2020 · 1 repository · arXiv:2003.11818
• GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet
  25 Mar 2020 · 0 repositories · arXiv:2003.11236
• ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  23 Mar 2020 · 19 repositories · arXiv:2003.10555
  Syntology official: no sample here; runs from other or unrecorded repositories · 31 ran (of which 7 constructed an object rather than computing a result; 18 with no instrument failure: 2 honoured, 2 violated, 14 with no contract checked; 13 where Syntology's instrument failed) · 9 unverified (of 40 harvested samples) · 10 pointer-only (licence)
• Finnish Language Modeling with Deep Transformer Models
  14 Mar 2020 · 0 repositories · arXiv:2003.11562
• Generating Major Types of Chinese Classical Poetry in a Uniformed Framework
  13 Mar 2020 · 0 repositories · arXiv:2003.11528
• Improved Baselines with Momentum Contrastive Learning
  9 Mar 2020 · 36 repositories · arXiv:2003.04297
  Syntology official: no sample here; runs from other or unrecorded repositories · 28 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 1 violated, 20 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified (of 43 harvested samples) · 15 pointer-only (licence)
• RecipeGPT: Generative Pre-training Based Cooking Recipe Generation and Evaluation System
  5 Mar 2020 · 1 repository · arXiv:2003.02498
• Hybrid Generative-Retrieval Transformers for Dialogue Domain Adaptation
  3 Mar 2020 · 0 repositories · arXiv:2003.01680
• Training Question Answering Models From Synthetic Data
  22 Feb 2020 · 0 repositories · arXiv:2002.09599
• Transformer on a Diet
  14 Feb 2020 · 1 repository · arXiv:2002.06170
• CBAG: Conditional Biomedical Abstract Generation
  13 Feb 2020 · 0 repositories · arXiv:2002.05637
• Training Large Neural Networks with Constant Memory using a New Execution Algorithm
  13 Feb 2020 · 2 repositories · arXiv:2002.05645
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Introducing Aspects of Creativity in Automatic Poetry Generation
  6 Feb 2020 · 1 repository · arXiv:2002.02511
• Joint Contextual Modeling for ASR Correction and Language Understanding
  28 Jan 2020 · 0 repositories · arXiv:2002.00750
• Reducing Non-Normative Text Generation from Language Models
  23 Jan 2020 · 0 repositories · arXiv:2001.08764
• Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network
  17 Jan 2020 · 1 repository · arXiv:2001.06268
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified (of 11 harvested samples)
• PatentTransformer-2: Controlling Patent Text Generation by Structural Metadata
  11 Jan 2020 · 0 repositories · arXiv:2001.03708
• OTEANN: Estimating the Transparency of Orthographies with an Artificial Neural Network
  31 Dec 2019 · 2 repositories · arXiv:1912.13321
• Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection
  25 Dec 2019 · 2 repositories · arXiv:1912.11637
  Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 1 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• SpineNet: Learning Scale-Permuted Backbone for Recognition and Localization
  10 Dec 2019 · 13 repositories · arXiv:1912.05027
• Personalized Patent Claim Generation and Measurement
  7 Dec 2019 · 0 repositories · arXiv:1912.03502
• A Comparative Study of Pretrained Language Models on Thai Social Text Categorization
  3 Dec 2019 · 0 repositories · arXiv:1912.01580
• Neural Academic Paper Generation
  2 Dec 2019 · 1 repository · arXiv:1912.01982
• What's Hidden in a Randomly Weighted Neural Network?
  29 Nov 2019 · 4 repositories · arXiv:1911.13299
  Syntology official (archive's flag): 5 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 5 pointer-only (licence)
• DeFINE: DEep Factorized INput Token Embeddings for Neural Sequence Modeling
  27 Nov 2019 · 1 repository · arXiv:1911.12385
• Evaluating Commonsense in Pre-trained Language Models
  27 Nov 2019 · 1 repository · arXiv:1911.11931
• Learning Spatial Fusion for Single-Shot Object Detection
  21 Nov 2019 · 1 repository · arXiv:1911.09516
• Paraphrasing with Large Language Models
  21 Nov 2019 · 0 repositories · arXiv:1911.09661
• EfficientDet: Scalable and Efficient Object Detection
  20 Nov 2019 · 64 repositories · arXiv:1911.09070
  Syntology official (archive's flag): 1 ran · 55 ran (of which 1 constructed an object rather than computing a result; 48 with no instrument failure: 4 honoured, 0 violated, 44 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified (of 70 harvested samples) · 7 pointer-only (licence)
• Unsupervised Natural Question Answering with a Small Model
  19 Nov 2019 · 0 repositories · arXiv:1911.08340
• Compressive Transformers for Long-Range Sequence Modelling
  13 Nov 2019 · 6 repositories · arXiv:1911.05507
  Syntology 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 2 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
• Attending to Entities for Better Text Understanding
  11 Nov 2019 · 0 repositories · arXiv:1911.04361
• INSET: Sentence Infilling with INter-SEntential Transformer
  10 Nov 2019 · 1 repository · arXiv:1911.03892
• Zero-Shot Paraphrase Generation with Multilingual Language Models
  9 Nov 2019 · 0 repositories · arXiv:1911.03597
• Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs
  7 Nov 2019 · 2 repositories · arXiv:1911.02707
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
• Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds
  6 Nov 2019 · 0 repositories · arXiv:1911.02365
• Assessing Social and Intersectional Biases in Contextualized Word Representations
  4 Nov 2019 · 1 repository · arXiv:1911.01485
• GEM: Generative Enhanced Model for adversarial attacks
  1 Nov 2019 · 0 repositories
• Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension
  1 Nov 2019 · 0 repositories
• Natural Language Generation for Effective Knowledge Distillation
  1 Nov 2019 · 1 repository
• Selecting, Planning, and Rewriting: A Modular Approach for Data-to-Document Generation and Translation
  1 Nov 2019 · 0 repositories
• Masked Language Model Scoring
  31 Oct 2019 · 6 repositories · arXiv:1910.14659
  Syntology official: no sample here; runs from other or unrecorded repositories · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 3 pointer-only (licence)
• Towards calibrated and scalable uncertainty representations for neural networks
  28 Oct 2019 · 0 repositories · arXiv:1911.00104
• An Empirical Study of Efficient ASR Rescoring with Transformers
  24 Oct 2019 · 0 repositories · arXiv:1910.11450
• Correction of Automatic Speech Recognition with Transformer Sequence-to-sequence Model
  23 Oct 2019 · 0 repositories · arXiv:1910.10697
• Evolution of transfer learning in natural language processing
  16 Oct 2019 · 0 repositories · arXiv:1910.07370
• Q8BERT: Quantized 8Bit BERT
  14 Oct 2019 · 5 repositories · arXiv:1910.06188
  Syntology official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 3 pointer-only (licence)
• Stabilizing Transformers for Reinforcement Learning
  13 Oct 2019 · 5 repositories · arXiv:1910.06764
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Multilingual Question Answering from Formatted Text applied to Conversational Agents
  10 Oct 2019 · 0 repositories · arXiv:1910.04659
• Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models
  9 Oct 2019 · 1 repository · arXiv:1910.03756
• Deformable Kernels: Adapting Effective Receptive Fields for Object Deformation
  7 Oct 2019 · 2 repositories · arXiv:1910.02940
• ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
  4 Oct 2019 · 10 repositories · arXiv:1910.02054
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Towards Understanding of Medical Randomized Controlled Trials by Conclusion Generation
  3 Oct 2019 · 1 repository · arXiv:1910.01462
• TMLab: Generative Enhanced Model (GEM) for adversarial attacks
  1 Oct 2019 · 0 repositories · arXiv:1910.00337
• RandAugment: Practical automated data augmentation with a reduced search space
  30 Sep 2019 · 19 repositories · arXiv:1909.13719
  Syntology 58 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 51 where Syntology's instrument failed) · 7 unverified (of 65 harvested samples) · 17 pointer-only (licence)
• GDP: Generalized Device Placement for Dataflow Graphs
  28 Sep 2019 · 0 repositories · arXiv:1910.01578
• Extremely Small BERT Models from Mixed-Vocabulary Training
  25 Sep 2019 · 0 repositories · arXiv:1909.11687
• How Additional Knowledge can Improve Natural Language Commonsense Question Answering?
  19 Sep 2019 · 0 repositories · arXiv:1909.08855