Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 67

Linear Warmup With Linear Decay

Papers archive 2025-07-28

archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)

Page 67 of 71: papers 6,601 to 6,700 of 7,076, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Divisive Language and Propaganda Detection using Multi-head Attention Transformers with Deep Learning BERT-based Language Models for Binary Classification
  1 Nov 2019 · 0 repositories
• Domain Adaptation with BERT-based Domain Classification and Data Selection
  1 Nov 2019 · 0 repositories
• Enhancing BERT for Lexical Normalization
  1 Nov 2019 · 0 repositories
• Evaluating BERT for natural language inference: A case study on the CommitmentBank
  1 Nov 2019 · 0 repositories
• Event Causality Recognition Exploiting Multiple Annotators' Judgments and Background Knowledge
  1 Nov 2019 · 0 repositories
• Extract and Aggregate: A Novel Domain-Independent Approach to Factual Data Verification
  1 Nov 2019 · 0 repositories
• Extractive NarrativeQA with Heuristic Pre-Training
  1 Nov 2019 · 0 repositories
• FASPell: A Fast, Adaptable, Simple, Powerful Chinese Spell Checker Based On DAE-Decoder Paradigm
  1 Nov 2019 · 1 repository
• Fine-Grained Propaganda Detection with Fine-Tuned BERT
  1 Nov 2019 · 0 repositories
• Fine-tune BERT with Sparse Self-Attention Mechanism
  1 Nov 2019 · 0 repositories
• From Monolingual to Multilingual FAQ Assistant using Multilingual Co-training
  1 Nov 2019 · 0 repositories
• Fully Unsupervised Crosslingual Semantic Textual Similarity Metric Based on BERT for Identifying Parallel Data
  1 Nov 2019 · 0 repositories
• Generalizing Question Answering System with Pre-trained Language Model Fine-tuning
  1 Nov 2019 · 0 repositories
• HIT-SCIR at MRP 2019: A Unified Pipeline for Meaning Representation Parsing via Efficient Training and Effective Encoding
  1 Nov 2019 · 0 repositories
• How well do NLI models capture verb veridicality?
  1 Nov 2019 · 0 repositories
• IIT-KGP at COIN 2019: Using pre-trained Language Models for modeling Machine Comprehension
  1 Nov 2019 · 0 repositories
• Improving Pre-Trained Multilingual Model with Vocabulary Expansion
  1 Nov 2019 · 0 repositories
• Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension
  1 Nov 2019 · 0 repositories
• JBNU at MRP 2019: Multi-level Biaffine Attention for Semantic Dependency Parsing
  1 Nov 2019 · 0 repositories
• Jeff Da at COIN - Shared Task: BIG MOOD: Relating Transformers to Explicit Commonsense Knowledge
  1 Nov 2019 · 0 repositories
• JUSTDeep at NLP4IF 2019 Task 1: Propaganda Detection using Ensemble Deep Learning Models
  1 Nov 2019 · 0 repositories
• LexicalAT: Lexical-Based Adversarial Reinforcement Training for Robust Sentiment Classification
  1 Nov 2019 · 0 repositories
• Multi-View Domain Adapted Sentence Embeddings for Low-Resource Unsupervised Duplicate Question Detection
  1 Nov 2019 · 0 repositories
• Named Entity Recognition - Is There a Glass Ceiling?
  1 Nov 2019 · 0 repositories
• Natural Language Generation for Effective Knowledge Distillation
  1 Nov 2019 · 1 repository
• No, you're not alone: A better way to find people with similar experiences on Reddit
  1 Nov 2019 · 0 repositories
• NSIT@NLP4IF-2019: Propaganda Detection from News Articles using Transfer Learning
  1 Nov 2019 · 0 repositories
• Pingan Smart Health and SJTU at COIN - Shared Task: utilizing Pre-trained Language Models and Common-sense Knowledge in Machine Reading Tasks
  1 Nov 2019 · 0 repositories
• Policy Preference Detection in Parliamentary Debate Motions
  1 Nov 2019 · 0 repositories
• Pre-Training BERT on Domain Resources for Short Answer Grading
  1 Nov 2019 · 0 repositories
• Question Answering Using Hierarchical Attention on Top of BERT Features
  1 Nov 2019 · 0 repositories
• Recycling a Pre-trained BERT Encoder for Neural Machine Translation
  1 Nov 2019 · 0 repositories
• Reevaluating Argument Component Extraction in Low Resource Settings
  1 Nov 2019 · 0 repositories
• Relation Module for Non-Answerable Predictions on Reading Comprehension
  1 Nov 2019 · 0 repositories
• Sentence-Level Propaganda Detection in News Articles with Transfer Learning and BERT-BiLSTM-Capsule Model
  1 Nov 2019 · 0 repositories
• SUDA-Alibaba at MRP 2019: Graph-Based Models with BERT
  1 Nov 2019 · 0 repositories
• SUM-QE: a BERT-based Summary Quality Estimation Model
  1 Nov 2019 · 0 repositories
• Team DOMLIN: Exploiting Evidence Enhancement for the FEVER Shared Task
  1 Nov 2019 · 0 repositories
• Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task
  1 Nov 2019 · 0 repositories
• TUPA at MRP 2019: A Multi-Task Baseline System
  1 Nov 2019 · 0 repositories
• Unsupervised Labeled Parsing with Deep Inside-Outside Recursive Autoencoders
  1 Nov 2019 · 0 repositories
• What Does This Word Mean? Explaining Contextualized Embeddings with Natural Language Definition
  1 Nov 2019 · 0 repositories
• When Choosing Plausible Alternatives, Clever Hans can be Clever
  1 Nov 2019 · 0 repositories · arXiv:1911.00225
• DiaNet: BERT and Hierarchical Attention Multi-Task Learning of Fine-Grained Dialect
  31 Oct 2019 · 0 repositories · arXiv:1910.14243
• Do Multi-hop Readers Dream of Reasoning Chains?
  31 Oct 2019 · 1 repository · arXiv:1910.14520
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 2 pointer-only (licence)
• Human-centric Metric for Accelerating Pathology Reports Annotation
  31 Oct 2019 · 0 repositories · arXiv:1911.01226
• LIMIT-BERT : Linguistic Informed Multi-Task BERT
  31 Oct 2019 · 0 repositories · arXiv:1910.14296
• Multi-Stage Document Ranking with BERT
  31 Oct 2019 · 3 repositories · arXiv:1910.14424
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
• Positional Attention-based Frame Identification with BERT: A Deep Learning Approach to Target Disambiguation and Semantic Frame Selection
  31 Oct 2019 · 0 repositories · arXiv:1910.14549
• Masked Language Model Scoring
  31 Oct 2019 · 6 repositories · arXiv:1910.14659
  Syntology official: no sample here; runs from other or unrecorded repositories · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 3 pointer-only (licence)
• Transfer Learning from Transformers to Fake News Challenge Stance Detection (FNC-1) Task
  31 Oct 2019 · 0 repositories · arXiv:1910.14353
• Discourse-Aware Neural Extractive Text Summarization
  30 Oct 2019 · 1 repository · arXiv:1910.14142
  Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 1 pointer-only (licence)
• Lsh-sampling Breaks the Computation Chicken-and-egg Loop in Adaptive Stochastic Gradient Estimation
  30 Oct 2019 · 0 repositories · arXiv:1910.14162
• Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Models
  30 Oct 2019 · 2 repositories · arXiv:1910.13664
• Time to Take Emoji Seriously: They Vastly Improve Casual Conversational Models
  30 Oct 2019 · 0 repositories · arXiv:1910.13793
• Sentence Embeddings for Russian NLU
  29 Oct 2019 · 1 repository · arXiv:1910.13291
• Inducing brain-relevant bias in natural language processing models
  29 Oct 2019 · 1 repository · arXiv:1911.03268
  Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Learning Rich Image Region Representation for Visual Question Answering
  29 Oct 2019 · 0 repositories · arXiv:1910.13077
• A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Media
  28 Oct 2019 · 2 repositories · arXiv:1910.12574
  Syntology 0 ran · 1 unverified (of 1 harvested sample)
• A Simple but Effective BERT Model for Dialog State Tracking on Resource-Limited Systems
  28 Oct 2019 · 0 repositories · arXiv:1910.12995
• Modeling Inter-Speaker Relationship in XLNet for Contextual Spoken Language Understanding
  28 Oct 2019 · 0 repositories · arXiv:1910.12531
• Sequence-to-sequence Automatic Speech Recognition with Word Embedding Regularization and Fused Decoding
  28 Oct 2019 · 1 repository · arXiv:1910.12740
• What does BERT Learn from Multiple-Choice Reading Comprehension Datasets?
  28 Oct 2019 · 0 repositories · arXiv:1910.12391
• Word-level Textual Adversarial Attacking as Combinatorial Optimization
  27 Oct 2019 · 1 repository · arXiv:1910.12196
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
• Thieves on Sesame Street! Model Extraction of BERT-based APIs
  27 Oct 2019 · 1 repository · arXiv:1910.12366
• DENS: A Dataset for Multi-class Emotion Analysis
  25 Oct 2019 · 0 repositories · arXiv:1910.11769
• HUBERT Untangles BERT to Improve Transfer across NLP Tasks
  25 Oct 2019 · 1 repository · arXiv:1910.12647
• L2RS: A Learning-to-Rescore Mechanism for Automatic Speech Recognition
  25 Oct 2019 · 0 repositories · arXiv:1910.11496
• On the Cross-lingual Transferability of Monolingual Representations
  25 Oct 2019 · 7 repositories · arXiv:1910.11856
  Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
• SpeechBERT: An Audio-and-text Jointly Learned Language Model for End-to-end Spoken Question Answering
  25 Oct 2019 · 0 repositories · arXiv:1910.11559
• Combining Acoustics, Content and Interaction Features to Find Hot Spots in Meetings
  24 Oct 2019 · 0 repositories · arXiv:1910.10869
• Emergent Properties of Finetuned Language Representation Models
  23 Oct 2019 · 0 repositories · arXiv:1910.10832
• Hierarchical Transformers for Long Document Classification
  23 Oct 2019 · 3 repositories · arXiv:1910.10781
• Relation Module for Non-answerable Prediction on Question Answering
  23 Oct 2019 · 0 repositories · arXiv:1910.10843
• Speech-XLNet: Unsupervised Acoustic Model Pretraining For Self-Attention Networks
  23 Oct 2019 · 0 repositories · arXiv:1910.10387
• MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehension
  22 Oct 2019 · 1 repository · arXiv:1910.09753
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• MonaLog: a Lightweight System for Natural Language Inference Based on Monotonicity
  19 Oct 2019 · 1 repository · arXiv:1910.08772
• XL-Editor: Post-editing Sentences with XLNet
  19 Oct 2019 · 0 repositories · arXiv:1910.10479
• A Mutual Information Maximization Perspective of Language Representation Learning
  18 Oct 2019 · 0 repositories · arXiv:1910.08350
• Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System
  18 Oct 2019 · 0 repositories · arXiv:1910.08381
• BIG MOOD: Relating Transformers to Explicit Commonsense Knowledge
  17 Oct 2019 · 0 repositories · arXiv:1910.07713
• Measuring semantic similarity of clinical trial outcomes using deep pre-trained language representations
  17 Oct 2019 · 0 repositories
• Universal Text Representation from BERT: An Empirical Study
  17 Oct 2019 · 0 repositories · arXiv:1910.07973
• BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Model Performance
  16 Oct 2019 · 1 repository · arXiv:1910.07181
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Bridging the Knowledge Gap: Enhancing Question Answering with World and Domain Knowledge
  16 Oct 2019 · 0 repositories · arXiv:1910.07429
• Evolution of transfer learning in natural language processing
  16 Oct 2019 · 0 repositories · arXiv:1910.07370
• Aligning Cross-Lingual Entities with Multi-Aspect Information
  15 Oct 2019 · 1 repository · arXiv:1910.06575
• Answering Complex Open-domain Questions Through Iterative Query Generation
  15 Oct 2019 · 1 repository · arXiv:1910.07000
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Structured Pruning of a BERT-based Question Answering Model
  14 Oct 2019 · 0 repositories · arXiv:1910.06360
• Q8BERT: Quantized 8Bit BERT
  14 Oct 2019 · 5 repositories · arXiv:1910.06188
  Syntology official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 3 pointer-only (licence)
• STANCY: Stance Classification Based on Consistency Cues
  14 Oct 2019 · 1 repository · arXiv:1910.06048
• Whatcha lookin' at? DeepLIFTing BERT's Attention in Question Answering
  14 Oct 2019 · 1 repository · arXiv:1910.06431
• Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT
  13 Oct 2019 · 0 repositories · arXiv:1910.05786
• vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
  12 Oct 2019 · 3 repositories · arXiv:1910.05453
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Automatic segmentation of texts into units of meaning for reading assistance
  11 Oct 2019 · 0 repositories · arXiv:1910.05014
• BiPaR: A Bilingual Parallel Dataset for Multilingual and Cross-lingual Reading Comprehension on Novels
  11 Oct 2019 · 1 repository · arXiv:1910.05040
• exBERT: A Visual Analysis Tool to Explore Learned Representations in Transformers Models
  11 Oct 2019 · 1 repository · arXiv:1910.05276
• Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework
  10 Oct 2019 · 2 repositories · arXiv:1910.04708
• FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams
  10 Oct 2019 · 3 repositories · arXiv:1910.04345
• Multi-label Categorization of Accounts of Sexism using a Neural Framework
  10 Oct 2019 · 1 repository · arXiv:1910.04602