Methods › General › Learning Rate Schedules › Cosine Annealing › Papers, page 38
Cosine Annealing
Papers archive 2025-07-28
archive papers tagged: 3,965 · with a code link: 1,734 · where Syntology ran a sample: 627 (513 with a run with no instrument failure, 114 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (627 of 3,965 tagged: 513 with a run with no instrument failure, 114 where every run was a failure of Syntology's instrument)
Page 38 of 40: papers 3,701 to 3,800 of 3,965, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Increasing Learning Efficiency of Self-Attention Networks through Direct Position Interactions, Learnable Temperature, and Convoluted Attention 1 Dec 2020 · 1 repository
-
TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching 1 Dec 2020 · 1 repository
-
UI at SemEval-2020 Task 4: Commonsense Validation and Explanation by Exploiting Contradiction 1 Dec 2020 · 0 repositories
-
Generative Pre-training for Paraphrase Generation by Representing and Predicting Spans in Exemplars 29 Nov 2020 · 0 repositories · arXiv:2011.14344
-
Automatic Detection of Cardiac Chambers Using an Attention-based YOLOv4 Framework from Four-chamber View of Fetal Echocardiography 26 Nov 2020 · 0 repositories · arXiv:2011.13096
-
An Efficient and Scalable Deep Learning Approach for Road Damage Detection 18 Nov 2020 · 2 repositories · arXiv:2011.09577
-
Do Fine-tuned Commonsense Language Models Really Generalize? 18 Nov 2020 · 0 repositories · arXiv:2011.09159
-
A comparative approach on detecting multi-lingual and multi-oriented text in natural scene images 17 Nov 2020 · 0 repositories
-
Attention Mechanism, Transformers, BERT, and GPT: Tutorial and Survey 17 Nov 2020 · 0 repositories
-
Scaled-YOLOv4: Scaling Cross Stage Partial Network 16 Nov 2020 · 41 repositories · arXiv:2011.08036Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning 15 Nov 2020 · 1 repository · arXiv:2011.07631
-
DebateSum: A large-scale argument mining and summarization dataset 14 Nov 2020 · 3 repositories · arXiv:2011.07251Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Real-time object detection method based on improved YOLOv4-tiny 9 Nov 2020 · 1 repository · arXiv:2011.04244
-
Adapting a Language Model for Controlled Affective Text Generation 8 Nov 2020 · 1 repository · arXiv:2011.04000Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Semi-Supervised Low-Resource Style Transfer of Indonesian Informal to Formal Language with Iterative Forward-Translation 6 Nov 2020 · 1 repository · arXiv:2011.03286
-
Improving RNN transducer with normalized jointer network 3 Nov 2020 · 0 repositories · arXiv:2011.01576
-
Tabular Transformers for Modeling Multivariate Time Series 3 Nov 2020 · 1 repository · arXiv:2011.01843Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)
-
The Amazing World of Neural Language Generation 1 Nov 2020 · 0 repositories
-
Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions 1 Nov 2020 · 1 repository
-
Topic-Preserving Synthetic News Generation: An Adversarial Deep Reinforcement Learning Approach 30 Oct 2020 · 0 repositories · arXiv:2010.16324
-
Unsupervised Paraphrasing with Pretrained Language Models 24 Oct 2020 · 0 repositories · arXiv:2010.12885
-
LightSeq: A High Performance Inference Library for Transformers 23 Oct 2020 · 1 repository · arXiv:2010.13887
-
Topic Modeling with Contextualized Word Representation Clusters 23 Oct 2020 · 0 repositories · arXiv:2010.12626
-
Developing Real-time Streaming Transformer Transducer for Speech Recognition on Large-scale Dataset 22 Oct 2020 · 0 repositories · arXiv:2010.11395
-
Transferable Graph Optimizers for ML Compilers 21 Oct 2020 · 0 repositories · arXiv:2010.12438
-
Performance of Transfer Learning Model vs. Traditional Neural Network in Low System Resource Environment 20 Oct 2020 · 0 repositories · arXiv:2011.07962
-
Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filtering 19 Oct 2020 · 0 repositories · arXiv:2010.09598
-
DA-Transformer: Distance-aware Transformer 14 Oct 2020 · 0 repositories · arXiv:2010.06925
-
Decoding Methods for Neural Narrative Generation 14 Oct 2020 · 2 repositories · arXiv:2010.07375
-
Memformer: A Memory-Augmented Transformer for Sequence Modeling 14 Oct 2020 · 0 repositories · arXiv:2010.06891
-
The workweek is the best time to start a family -- A Study of GPT-2 Based Claim Generation 13 Oct 2020 · 0 repositories · arXiv:2010.06185
-
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs 12 Oct 2020 · 3 repositories · arXiv:2010.05953Syntology official (archive's flag): 1 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
Meta-Context Transformers for Domain-Specific Response Generation 12 Oct 2020 · 1 repository · arXiv:2010.05572
-
Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU 11 Oct 2020 · 1 repository · arXiv:2010.05330
-
Investigating African-American Vernacular English in Transformer-Based Text Generation 6 Oct 2020 · 1 repository · arXiv:2010.02510
-
Scene Graph Modification Based on Natural Language Commands 6 Oct 2020 · 1 repository · arXiv:2010.02591
-
GenAug: Data Augmentation for Finetuning Text Generators 5 Oct 2020 · 2 repositories · arXiv:2010.01794
-
Inquisitive Question Generation for High Level Text Comprehension 4 Oct 2020 · 1 repository · arXiv:2010.01657
-
Examining the rhetorical capacities of neural language models 1 Oct 2020 · 0 repositories · arXiv:2010.00153
-
The design and implementation of Language Learning Chatbot with XAI using Ontology and Transfer Learning 29 Sep 2020 · 0 repositories · arXiv:2009.13984
-
Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions 29 Sep 2020 · 1 repository · arXiv:2009.14259Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Detecting soccer balls with reduced neural networks: a comparison of multiple architectures under constrained hardware scenarios 28 Sep 2020 · 1 repository · arXiv:2009.13684
-
Toward a Thermodynamics of Meaning 24 Sep 2020 · 1 repository · arXiv:2009.11963
-
On Data Augmentation for Extreme Multi-label Classification 22 Sep 2020 · 0 repositories · arXiv:2009.10778
-
Prior Art Search and Reranking for Generated Patent Text 19 Sep 2020 · 0 repositories · arXiv:2009.09132
-
Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models 18 Sep 2020 · 0 repositories · arXiv:2009.08636
-
RCNN for Region of Interest Detection in Whole Slide Images 16 Sep 2020 · 1 repository · arXiv:2009.07532
-
Critical Thinking for Language Models 15 Sep 2020 · 1 repository · arXiv:2009.07185Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Dialogue Response Ranking Training with Large-Scale Human Feedback Data 15 Sep 2020 · 2 repositories · arXiv:2009.06978Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners 15 Sep 2020 · 5 repositories · arXiv:2009.07118
-
The Radicalization Risks of GPT-3 and Advanced Neural Language Models 15 Sep 2020 · 0 repositories · arXiv:2009.06807
-
GeDi: Generative Discriminator Guided Sequence Generation 14 Sep 2020 · 3 repositories · arXiv:2009.06367Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding 13 Sep 2020 · 0 repositories · arXiv:2009.06097
-
YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design 12 Sep 2020 · 3 repositories · arXiv:2009.05697
-
Unit Test Case Generation with Transformers and Focal Context 11 Sep 2020 · 1 repository · arXiv:2009.05617
-
Brain2Word: Decoding Brain Activity for Language Generation 10 Sep 2020 · 1 repository · arXiv:2009.04765
-
Modern Methods for Text Generation 10 Sep 2020 · 2 repositories · arXiv:2009.04968
-
Sparsifying Transformer Models with Trainable Representation Pooling 10 Sep 2020 · 1 repository · arXiv:2009.05169
-
Pay Attention when Required 9 Sep 2020 · 2 repositories · arXiv:2009.04534
-
Black Box to White Box: Discover Model Characteristics Based on Strategic Probing 7 Sep 2020 · 0 repositories · arXiv:2009.03136
-
Improving Language Generation with Sentence Coherence Objective 7 Sep 2020 · 1 repository · arXiv:2009.06358
-
Measuring Massive Multitask Language Understanding 7 Sep 2020 · 18 repositories · arXiv:2009.03300Syntology community repositories only · 19 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 0 violated, 15 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 26 harvested samples) · 1 pointer-only (licence)
-
Comparative Evaluation of Pretrained Transfer Learning Models on Automatic Short Answer Grading 2 Sep 2020 · 1 repository · arXiv:2009.01303
-
Knowledge Efficient Deep Learning for Natural Language Processing 28 Aug 2020 · 0 repositories · arXiv:2008.12878
-
DAVE: Deriving Automatically Verilog from English 27 Aug 2020 · 0 repositories · arXiv:2009.01026
-
Discrete Word Embedding for Logical Natural Language Understanding 26 Aug 2020 · 0 repositories · arXiv:2008.11649
-
ETC-NLG: End-to-end Topic-Conditioned Natural Language Generation 25 Aug 2020 · 1 repository · arXiv:2008.10875
-
Dynamics of feed forward induced interference training 24 Aug 2020 · 0 repositories · arXiv:2008.11111
-
Explainable end-to-end deep learning for diabetic retinopathy detection across multiple datasets 20 Aug 2020 · 0 repositories
-
Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study 17 Aug 2020 · 0 repositories · arXiv:2008.13533
-
Narrative Interpolation for Generating and Understanding Stories 17 Aug 2020 · 0 repositories · arXiv:2008.07466
-
Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size 16 Aug 2020 · 0 repositories · arXiv:2008.07027
-
Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems 14 Aug 2020 · 0 repositories · arXiv:2008.06239
-
Navigating Human Language Models with Synthetic Agents 10 Aug 2020 · 0 repositories · arXiv:2008.04162
-
The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measures 4 Aug 2020 · 2 repositories · arXiv:2008.01307Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples)
-
Multi-node Bert-pretraining: Cost-efficient Approach 1 Aug 2020 · 0 repositories · arXiv:2008.00177
-
Trojaning Language Models for Fun and Profit 1 Aug 2020 · 1 repository · arXiv:2008.00312
-
Language Modelling for Source Code with Transformer-XL 31 Jul 2020 · 1 repository · arXiv:2007.15813
-
Object Detection and Tracking Algorithms for Vehicle Counting: A Comparative Analysis 31 Jul 2020 · 0 repositories · arXiv:2007.16198
-
TweepFake: about Detecting Deepfake Tweets 31 Jul 2020 · 1 repository · arXiv:2008.00036
-
Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining 29 Jul 2020 · 1 repository · arXiv:2007.14587
-
PP-YOLO: An Effective and Efficient Implementation of Object Detector 23 Jul 2020 · 5 repositories · arXiv:2007.12099
-
Generative Pretraining from Pixels 17 Jul 2020 · 4 repositories
-
Deep Transformer based Data Augmentation with Subword Units for Morphologically Rich Online ASR 14 Jul 2020 · 0 repositories · arXiv:2007.06949
-
NVAE: A Deep Hierarchical Variational Autoencoder 8 Jul 2020 · 10 repositories · arXiv:2007.03898Syntology official (archive's flag): 9 ran · 26 ran (of which 15 constructed an object rather than computing a result; 21 with no instrument failure: 3 honoured, 0 violated, 18 with no contract checked; 5 where Syntology's instrument failed) · 15 unverified (of 41 harvested samples) · 23 pointer-only (licence)
-
Do Transformers Need Deep Long-Range Memory 7 Jul 2020 · 1 repository · arXiv:2007.03356
-
The Go Transformer: Natural Language Modeling for Game Play 7 Jul 2020 · 0 repositories · arXiv:2007.03500
-
You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion 5 Jul 2020 · 0 repositories · arXiv:2007.02220
-
On-The-Fly Information Retrieval Augmentation for Language Models 3 Jul 2020 · 0 repositories · arXiv:2007.01528
-
Do Transformers Need Deep Long-Range Memory? 1 Jul 2020 · 0 repositories
-
LSTM and GPT-2 Synthetic Speech Transfer Learning for Speaker Recognition to Overcome Data Scarcity 1 Jul 2020 · 0 repositories · arXiv:2007.00659
-
Probing for Referential Information in Language Models 1 Jul 2020 · 0 repositories
-
Roles and Utilization of Attention Heads in Transformer-based Neural Language Models 1 Jul 2020 · 1 repository
-
Towards Holistic and Automatic Evaluation of Open-Domain Dialogue Generation 1 Jul 2020 · 1 repository
-
Knowledge-Aware Language Model Pretraining 29 Jun 2020 · 0 repositories · arXiv:2007.00655
-
Progressive Generation of Long Text with Pretrained Language Models 28 Jun 2020 · 1 repository · arXiv:2006.15720Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization 27 Jun 2020 · 0 repositories · arXiv:2006.15435
-
Video-Grounded Dialogues with Pretrained Generation Language Models 27 Jun 2020 · 0 repositories · arXiv:2006.15319
-
Inductive Unsupervised Domain Adaptation for Few-Shot Classification via Clustering 23 Jun 2020 · 1 repository · arXiv:2006.12816
-
A Qualitative Evaluation of Language Models on Automatic Question-Answering for COVID-19 19 Jun 2020 · 1 repository · arXiv:2006.10964