Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 70

Linear Warmup With Linear Decay

Papers archive 2025-07-28

archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)

Page 70 of 71: papers 6,901 to 7,000 of 7,076, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• TWEETQA: A Social Media Focused Question Answering Dataset
  14 Jul 2019 · 0 repositories · arXiv:1907.06292
• BAM! Born-Again Multi-Task Networks for Natural Language Understanding
  10 Jul 2019 · 1 repository · arXiv:1907.04829
• Can Unconditional Language Models Recover Arbitrary Sentences?
  10 Jul 2019 · 0 repositories · arXiv:1907.04944
• Let's measure run time! Extending the IR replicability infrastructure to include performance aspects
  10 Jul 2019 · 0 repositories · arXiv:1907.04614
• To Tune or Not To Tune? How About the Best of Both Worlds?
  9 Jul 2019 · 2 repositories · arXiv:1907.05338
• Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks
  8 Jul 2019 · 0 repositories · arXiv:1907.03693
• Short Text Conversation Based on Deep Neural Network and Analysis on Evaluation Measures
  6 Jul 2019 · 1 repository · arXiv:1907.03070
• BERT-DST: Scalable End-to-End Dialogue State Tracking with Bidirectional Encoder Representations from Transformer
  5 Jul 2019 · 1 repository · arXiv:1907.03040
• A Simple and Effective Approach to Automatic Post-Editing with Transfer Learning
  1 Jul 2019 · 1 repository
• A Surprisingly Robust Trick for the Winograd Schema Challenge
  1 Jul 2019 · 0 repositories
• BERT-based Lexical Substitution
  1 Jul 2019 · 1 repository
• Coreference Resolution with Entity Equalization
  1 Jul 2019 · 1 repository
• DisSent: Learning Sentence Representations from Explicit Discourse Relations
  1 Jul 2019 · 1 repository
• Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension
  1 Jul 2019 · 1 repository
• Literary Event Detection
  1 Jul 2019 · 2 repositories
• Pentagon at MEDIQA 2019: Multi-task Learning for Filtering and Re-ranking Answers using Language Inference and Question Entailment
  1 Jul 2019 · 0 repositories · arXiv:1907.01643
• Using Database Rule for Weak Supervised Text-to-SQL Generation
  1 Jul 2019 · 2 repositories · arXiv:1907.00620
• What Does BERT Learn about the Structure of Language?
  1 Jul 2019 · 1 repository
• XQA: A Cross-lingual Open-domain Question Answering Dataset
  1 Jul 2019 · 1 repository
• Evaluating Language Model Finetuning Techniques for Low-resource Languages
  30 Jun 2019 · 2 repositories · arXiv:1907.00409
• Compositional Semantic Parsing Across Graphbanks
  27 Jun 2019 · 1 repository · arXiv:1906.11746
• Inducing Syntactic Trees from BERT Representations
  27 Jun 2019 · 0 repositories · arXiv:1906.11511
• Relating Simple Sentence Representations in Deep Neural Networks and the Brain
  27 Jun 2019 · 1 repository · arXiv:1906.11861
• Multilingual Named Entity Recognition Using Pretrained Embeddings, Attention Mechanism and NCRF
  21 Jun 2019 · 2 repositories · arXiv:1906.09978
• Pre-Training with Whole Word Masking for Chinese BERT
  19 Jun 2019 · 2 repositories · arXiv:1906.08101
• XLNet: Generalized Autoregressive Pretraining for Language Understanding
  19 Jun 2019 · 27 repositories · arXiv:1906.08237
  Syntology official (archive's flag): 1 ran · 15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified (of 24 harvested samples) · 4 pointer-only (licence)
• Measuring Bias in Contextualized Word Representations
  18 Jun 2019 · 1 repository · arXiv:1906.07337
• Transfer Learning for Causal Sentence Detection
  18 Jun 2019 · 2 repositories · arXiv:1906.07544
• Zero-Shot Entity Linking by Reading Entity Descriptions
  18 Jun 2019 · 3 repositories · arXiv:1906.07348
• Exploiting Unsupervised Pre-training and Automated Feature Engineering for Low-resource Hate Speech Detection in Polish
  17 Jun 2019 · 0 repositories · arXiv:1906.09325
• Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models
  17 Jun 2019 · 0 repositories · arXiv:1906.07307
• One Epoch Is All You Need
  16 Jun 2019 · 0 repositories · arXiv:1906.06669
• Context is Key: Grammatical Error Detection with Contextual Word Representations
  15 Jun 2019 · 1 repository · arXiv:1906.06593
• A Simple and Effective Approach to Automatic Post-Editing with Transfer Learning
  14 Jun 2019 · 1 repository · arXiv:1906.06253
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 1 pointer-only (licence)
• Learning Video Representations using Contrastive Bidirectional Transformer
  13 Jun 2019 · 0 repositories · arXiv:1906.05743
• Telephonetic: Making Neural Language Models Robust to ASR and Semantic Noise
  13 Jun 2019 · 0 repositories · arXiv:1906.05678
• A Multiscale Visualization of Attention in the Transformer Model
  12 Jun 2019 · 3 repositories · arXiv:1906.05714
  Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Neural Arabic Question Answering
  12 Jun 2019 · 1 repository · arXiv:1906.05394
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 2 pointer-only (licence)
• What Does BERT Look At? An Analysis of BERT's Attention
  11 Jun 2019 · 1 repository · arXiv:1906.04341
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• Learning to combine Grammatical Error Corrections
  10 Jun 2019 · 1 repository · arXiv:1906.03897
• Gendered Pronoun Resolution using BERT and an extractive question answering formulation
  9 Jun 2019 · 1 repository · arXiv:1906.03695
• Sentence Centrality Revisited for Unsupervised Summarization
  8 Jun 2019 · 1 repository · arXiv:1906.03508
• Leveraging BERT for Extractive Text Summarization on Lectures
  7 Jun 2019 · 8 repositories · arXiv:1906.04165
• Selfie: Self-supervised Pretraining for Image Embedding
  7 Jun 2019 · 1 repository · arXiv:1906.02940
• GCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labeling
  6 Jun 2019 · 1 repository · arXiv:1906.02437
• Visualizing and Measuring the Geometry of BERT
  6 Jun 2019 · 1 repository · arXiv:1906.02715
• Large-Scale Multi-Label Text Classification on EU Legislation
  5 Jun 2019 · 1 repository · arXiv:1906.02192
• Neural Legal Judgment Prediction in English
  5 Jun 2019 · 0 repositories · arXiv:1906.02059
• How multilingual is Multilingual BERT?
  4 Jun 2019 · 3 repositories · arXiv:1906.01502
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
• Open Sesame: Getting Inside BERT's Linguistic Knowledge
  4 Jun 2019 · 1 repository · arXiv:1906.01698
  Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 4 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 18 harvested samples) · 7 pointer-only (licence)
• Sequence Tagging with Contextual and Non-Contextual Subword Representations: A Multilingual Evaluation
  4 Jun 2019 · 1 repository · arXiv:1906.01569
• Pre-training of Graph Augmented Transformers for Medication Recommendation
  2 Jun 2019 · 1 repository · arXiv:1906.00346
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples)
• Adversarial Generation and Encoding of Nested Texts
  1 Jun 2019 · 0 repositories · arXiv:1906.00238
• A BERT-based Universal Model for Both Within- and Cross-sentence Clinical Temporal Relation Extraction
  1 Jun 2019 · 0 repositories
• A Structural Probe for Finding Syntax in Word Representations
  1 Jun 2019 · 1 repository
• AUTOHOME-ORCA at SemEval-2019 Task 8: Application of BERT for Fact-Checking in Community Forums
  1 Jun 2019 · 0 repositories
• BNU-HKBU UIC NLP Team 2 at SemEval-2019 Task 6: Detecting Offensive Language Using BERT model
  1 Jun 2019 · 0 repositories
• ConvAI at SemEval-2019 Task 6: Offensive Language Identification and Categorization with Perspective and BERT
  1 Jun 2019 · 0 repositories
• DOMLIN at SemEval-2019 Task 8: Automated Fact Checking exploiting Ratings in Community Question Answering Forums
  1 Jun 2019 · 0 repositories
• DS at SemEval-2019 Task 9: From Suggestion Mining with neural networks to adversarial cross-domain classification
  1 Jun 2019 · 0 repositories
• Embeddia at SemEval-2019 Task 6: Detecting Hate with Neural Network and Transfer Learning Approaches
  1 Jun 2019 · 1 repository
• Figure Eight at SemEval-2019 Task 3: Ensemble of Transfer Learning Methods for Contextual Emotion Detection
  1 Jun 2019 · 0 repositories
• HLT@SUDA at SemEval-2019 Task 1: UCCA Graph Parsing as Constituent Tree Parsing
  1 Jun 2019 · 0 repositories
• How Well Do Embedding Models Capture Non-compositionality? A View from Multiword Expressions
  1 Jun 2019 · 0 repositories
• KDEHatEval at SemEval-2019 Task 5: A Neural Network Model for Detecting Hate Speech in Twitter
  1 Jun 2019 · 0 repositories
• LTL-UDE at SemEval-2019 Task 6: BERT and Two-Vote Classification for Categorizing Offensiveness
  1 Jun 2019 · 0 repositories
• MITRE at SemEval-2019 Task 5: Transfer Learning for Multilingual Hate Speech Detection
  1 Jun 2019 · 0 repositories
• Opinion Mining with Deep Contextualized Embeddings
  1 Jun 2019 · 0 repositories
• Stance Classification, Outcome Prediction, and Impact Assessment: NLP Tasks for Studying Group Decision-Making
  1 Jun 2019 · 0 repositories
• Team Howard Beale at SemEval-2019 Task 4: Hyperpartisan News Detection with BERT
  1 Jun 2019 · 0 repositories
• Team Jack Ryder at SemEval-2019 Task 4: Using BERT Representations for Detecting Hyperpartisan News
  1 Jun 2019 · 0 repositories
• Team yeon-zi at SemEval-2019 Task 4: Hyperpartisan News Detection by De-noising Weakly-labeled Data
  1 Jun 2019 · 1 repository
• The Sally Smedley Hyperpartisan News Detector at SemEval-2019 Task 4
  1 Jun 2019 · 0 repositories
• Using Contextual Representations for Suicide Risk Assessment from Internet Forums
  1 Jun 2019 · 0 repositories
• ZQM at SemEval-2019 Task9: A Single Layer CNN Based on Pre-trained Model for Suggestion Mining
  1 Jun 2019 · 0 repositories
• Attention Is (not) All You Need for Commonsense Reasoning
  31 May 2019 · 2 repositories · arXiv:1905.13497
• MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension
  31 May 2019 · 1 repository · arXiv:1905.13453
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Audio Caption in a Car Setting with a Sentence-Level Loss
  31 May 2019 · 1 repository · arXiv:1905.13448
• A Simple but Effective Method to Incorporate Multi-turn Context with BERT for Conversational Machine Comprehension
  30 May 2019 · 0 repositories · arXiv:1905.12848
• Unbabel's Submission to the WMT2019 APE Shared Task: BERT-based Encoder-Decoder for Automatic Post-Editing
  30 May 2019 · 0 repositories · arXiv:1905.13068
• A Generalized Framework of Sequence Generation with Application to Undirected Sequence Models
  29 May 2019 · 1 repository · arXiv:1905.12790
  Syntology official (archive's flag): 2 ran · 3 ran (of which 2 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Towards better substitution-based word sense induction
  29 May 2019 · 2 repositories · arXiv:1905.12598
• Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)
  28 May 2019 · 1 repository · arXiv:1905.11833
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• Combating Adversarial Misspellings with Robust Word Recognition
  27 May 2019 · 3 repositories · arXiv:1905.11268
• Compositional pre-training for neural semantic parsing
  27 May 2019 · 0 repositories · arXiv:1905.11531
• Hashing based Answer Selection
  26 May 2019 · 0 repositories · arXiv:1905.10718
• Are Sixteen Heads Really Better than One?
  25 May 2019 · 4 repositories · arXiv:1905.10650
• Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers
  25 May 2019 · 3 repositories · arXiv:1905.10630
• BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
  24 May 2019 · 1 repository · arXiv:1905.10044
• Human vs. Muppet: A Conservative Estimate of Human Performance on the GLUE Benchmark
  24 May 2019 · 0 repositories · arXiv:1905.10425
• Deeper Text Understanding for IR with Contextual Neural Language Modeling
  22 May 2019 · 1 repository · arXiv:1905.09217
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 2 pointer-only (licence)
• Generating Logical Forms from Graph Representations of Text and Entities
  21 May 2019 · 0 repositories · arXiv:1905.08407
• Look Again at the Syntax: Relational Graph Convolutional Network for Gendered Ambiguous Pronoun Resolution
  21 May 2019 · 1 repository · arXiv:1905.08868
• Enriching Pre-trained Language Model with Entity Information for Relation Classification
  20 May 2019 · 6 repositories · arXiv:1905.08284
  Syntology 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
• HellaSwag: Can a Machine Really Finish Your Sentence?
  19 May 2019 · 2 repositories · arXiv:1905.07830
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 4 pointer-only (licence)
• BERTSel: Answer Selection with Pre-trained Models
  18 May 2019 · 1 repository · arXiv:1905.07588
• ERNIE: Enhanced Language Representation with Informative Entities
  17 May 2019 · 2 repositories · arXiv:1905.07129
  Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Story Ending Prediction by Transferable BERT
  17 May 2019 · 1 repository · arXiv:1905.07504
• Latent Universal Task-Specific BERT
  16 May 2019 · 0 repositories · arXiv:1905.06638
• A Surprisingly Robust Trick for Winograd Schema Challenge
  15 May 2019 · 2 repositories · arXiv:1905.06290