Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 41
Linear Warmup With Linear Decay
Papers archive 2025-07-28
archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)
Page 41 of 71: papers 4,001 to 4,100 of 7,076, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Speech Tasks Relevant to Sleepiness Determined with Deep Transfer Learning 29 Nov 2021 · 0 repositories · arXiv:2111.14684
-
Tapping BERT for Preposition Sense Disambiguation 27 Nov 2021 · 0 repositories · arXiv:2111.13972
-
Predicting Document Coverage for Relation Extraction 26 Nov 2021 · 0 repositories · arXiv:2111.13611
-
Does constituency analysis enhance domain-specific pre-trained BERT models for relation extraction? 25 Nov 2021 · 0 repositories · arXiv:2112.02955
-
Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators 25 Nov 2021 · 1 repository · arXiv:2111.13057
-
New Approaches to Long Document Summarization: Fourier Transform Based Attention in a Transformer Model 25 Nov 2021 · 0 repositories · arXiv:2111.15473
-
Probabilistic Impact Score Generation using Ktrain-BERT to Identify Hate Words from Twitter Discussions 25 Nov 2021 · 0 repositories · arXiv:2111.12939
-
Recommending Multiple Positive Citations for Manuscript via Content-Dependent Modeling and Multi-Positive Triplet 25 Nov 2021 · 0 repositories · arXiv:2111.12899
-
Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress 25 Nov 2021 · 0 repositories · arXiv:2112.03014
-
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers 24 Nov 2021 · 1 repository · arXiv:2111.12710
-
DABS: A Domain-Agnostic Benchmark for Self-Supervised Learning 23 Nov 2021 · 1 repository · arXiv:2111.12062Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Variational Learning for Unsupervised Knowledge Grounded Dialogs 23 Nov 2021 · 1 repository · arXiv:2112.00653
-
Can depth-adaptive BERT perform better on binary classification tasks 22 Nov 2021 · 0 repositories · arXiv:2111.10951
-
Does BERT look at sentiment lexicon? 19 Nov 2021 · 0 repositories · arXiv:2111.10100
-
Lexicon-based Methods vs. BERT for Text Sentiment Analysis 19 Nov 2021 · 0 repositories · arXiv:2111.10097
-
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing 18 Nov 2021 · 3 repositories · arXiv:2111.09543Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Dynamic-TinyBERT: Boost TinyBERT's Inference Efficiency by Dynamic Sequence Length 18 Nov 2021 · 0 repositories · arXiv:2111.09645
-
LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model 18 Nov 2021 · 0 repositories · arXiv:2111.09564
-
RoBERTuito: a pre-trained language model for social media text in Spanish 18 Nov 2021 · 1 repository · arXiv:2111.09453Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
The Power of Selecting Key Blocks with Local Pre-ranking for Long Document Information Retrieval 18 Nov 2021 · 1 repository · arXiv:2111.09852
-
A Comparative Study on Transfer Learning and Distance Metrics in Semantic Clustering over the COVID-19 Tweets 16 Nov 2021 · 0 repositories · arXiv:2111.08658
-
A Flexible Multi-Task Model for BERT Serving 16 Nov 2021 · 0 repositories
-
A Graph Enhanced BERT Model for Event Prediction 16 Nov 2021 · 0 repositories
-
A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings 16 Nov 2021 · 0 repositories
-
A Structured Semantic Reinforcement method for Task-Oriented Dialogue 16 Nov 2021 · 0 repositories
-
AdapLeR: Speeding up Inference by Adaptive Length Reduction 16 Nov 2021 · 0 repositories
-
An Isotropy Analysis in the Multilingual BERT Embedding Space 16 Nov 2021 · 0 repositories
-
ANNA: Enhanced Language Representation for Question Answering 16 Nov 2021 · 0 repositories
-
Assessing the Coherence Modeling Capabilities of Pretrained Transformer-based Language Models 16 Nov 2021 · 0 repositories
-
Attention-based Multi-hypothesis Fusion for Speech Summarization 16 Nov 2021 · 2 repositories · arXiv:2111.08201
-
BERT got a Date: Introducing Transformers to Temporal Tagging 16 Nov 2021 · 0 repositories
-
BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classification 16 Nov 2021 · 0 repositories
-
BigFive: A Dataset of Coarse- and Fine-Grained Personality Characteristics 16 Nov 2021 · 0 repositories
-
BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog 16 Nov 2021 · 0 repositories
-
Building Chinese Biomedical Language Models via Multi-Level Text Discrimination 16 Nov 2021 · 1 repository
-
Chinese Word Attention based on Valid Division of Sentence 16 Nov 2021 · 0 repositories
-
Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in context 16 Nov 2021 · 0 repositories
-
Cross-domain Named Entity Recognition via Graph Matching 16 Nov 2021 · 0 repositories
-
CVSS-BERT: Explainable Natural Language Processing to Determine the Severity of a Computer Security Vulnerability from its Description 16 Nov 2021 · 1 repository · arXiv:2111.08510
-
Data Contamination: From Memorization to Exploitation 16 Nov 2021 · 0 repositories
-
DAWSON: Data Augmentation using Weak Supervision On Natural Language 16 Nov 2021 · 0 repositories
-
Deep-to-bottom Weights Decay: A Systemic Knowledge Review Learning Technique for Transformer Layers in Knowledge Distillation 16 Nov 2021 · 0 repositories
-
Discontinuous Constituency and BERT: A Case Study of Dutch 16 Nov 2021 · 0 repositories
-
ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models 16 Nov 2021 · 0 repositories
-
ELLE: Efficient Lifelong Pre-training for Emerging Data 16 Nov 2021 · 0 repositories
-
End-to-end Task-oriented Dialog Policy Learning based on Pre-trained Language Model 16 Nov 2021 · 0 repositories
-
Event Detection via Derangement Question Answering 16 Nov 2021 · 0 repositories
-
EventBERT 16 Nov 2021 · 0 repositories
-
Explicit Modeling the Context for Chinese NER 16 Nov 2021 · 0 repositories
-
Eye Gaze and Self-attention: How Humans and Transformers Attend Words in Sentences 16 Nov 2021 · 0 repositories
-
Feature-rich Open-vocabulary Interpretable Neural Representations for All of the World’s 7000 Languages 16 Nov 2021 · 0 repositories
-
Feature Structure Distillation for BERT Transferring 16 Nov 2021 · 0 repositories
-
gaBERT — an Irish Language Model 16 Nov 2021 · 0 repositories
-
Get the Point! Graph Enhanced Candidate Retrieval for Zero-shot Entity Linking 16 Nov 2021 · 0 repositories
-
GLM: General Language Model Pretraining with Autoregressive Blank Infilling 16 Nov 2021 · 0 repositories
-
Graph-based Fine-grained Multimodal Attention Mechanism for Sentiment Analysis 16 Nov 2021 · 0 repositories
-
How does the pre-training objective affect what large language models learn about linguistic properties? 16 Nov 2021 · 0 repositories
-
Impact of Tokenization on Language Models: An Analysis for Turkish 16 Nov 2021 · 0 repositories
-
Improving Neural Models for Radiology Report Retrieval with Lexicon-based Automated Annotation 16 Nov 2021 · 0 repositories
-
Improving Unsupervised Sentence Simplification Using Fine-Tuned Masked Language Models 16 Nov 2021 · 0 repositories
-
Input-specific Attention Subnetworks for Adversarial Detection 16 Nov 2021 · 0 repositories
-
Integrated Semantic and Phonetic Post-correction for Chinese Speech Recognition 16 Nov 2021 · 1 repository · arXiv:2111.08400
-
Interpreting Language Models Through Knowledge Graph Extraction 16 Nov 2021 · 1 repository · arXiv:2111.08546
-
Interpreting the Robustness of Neural NLP Models to Textual Perturbations 16 Nov 2021 · 0 repositories
-
Investigating the Use of BERT Anchors for Bilingual Lexicon Induction with Minimal Supervision 16 Nov 2021 · 0 repositories
-
Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics 16 Nov 2021 · 0 repositories
-
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction 16 Nov 2021 · 0 repositories
-
KinyaBERT: a Morphology-aware Kinyarwanda Language Model 16 Nov 2021 · 0 repositories
-
Knowledge Enhanced Embedding: Improve Model Generalization Through Knowledge Graphs 16 Nov 2021 · 0 repositories
-
Language Level Classification on German Texts using a Neural Approach 16 Nov 2021 · 0 repositories
-
Learning to Ignore Adversarial Attacks 16 Nov 2021 · 0 repositories
-
Looking Into the Black Box - How Are Idioms Processed in BERT? 16 Nov 2021 · 0 repositories
-
LordBERT: Embedding Long Text by Segment Ordering with BERT 16 Nov 2021 · 0 repositories
-
MarCQAp: Effective Context Modeling for Conversational Question Answering 16 Nov 2021 · 0 repositories
-
MarkBERT: Marking Word Boundaries Improves Chinese BERT 16 Nov 2021 · 1 repository
-
MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction 16 Nov 2021 · 0 repositories
-
Metadata Shaping: Natural Language Annotations for the Long Tail 16 Nov 2021 · 0 repositories
-
NSP-BERT: A Prompt-based Zero-Shot Learner Through an Original Pre-training Task —— Next Sentence Prediction 16 Nov 2021 · 0 repositories
-
On the Robustness of Reading Comprehension Models to Entity Renaming 16 Nov 2021 · 0 repositories
-
PARE: A Simple and Strong Baseline for Monolingual and Multilingual Distantly Supervised Relation Extraction 16 Nov 2021 · 0 repositories
-
Perturbations in the Wild: Leveraging Human-Written Text Perturbations for Realistic Adversarial Attack and Defense 16 Nov 2021 · 0 repositories
-
Pinyin-bert: A new solution to Chinese pinyin to character conversion task 16 Nov 2021 · 0 repositories
-
Probing BERT’s priors with serial reproduction chains 16 Nov 2021 · 0 repositories
-
PromptBERT: Improving BERT Sentence Embeddings with Prompts 16 Nov 2021 · 0 repositories
-
ReCo: Reliable Multi-hop Causal Reasoning via Structural Causal Recurrent Unit 16 Nov 2021 · 0 repositories
-
Representation of Ambiguity in Pre-Trained Sentence Embeddings 16 Nov 2021 · 0 repositories
-
SAMBERT: Improve Aspect Sentiment Triplet Extraction by Segmenting the Attention Maps of BERT 16 Nov 2021 · 0 repositories
-
Self-Supervised Contrastive Learning with Adversarial Perturbations for Robust Pretrained Language Models 16 Nov 2021 · 0 repositories
-
SHIELD: Defending Textual Neural Networks against Black-Box Adversarial Attacks with Stochastic Multi-Expert Patcher 16 Nov 2021 · 0 repositories
-
Softmax Bottleneck Makes Language Models Unable to Represent Multi-mode Word Distributions 16 Nov 2021 · 0 repositories
-
TACO: Pre-training of Deep Transformers with Attention Convolution using Disentangled Positional Representation 16 Nov 2021 · 0 repositories
-
The impact of lexical and grammatical processing on generating code from natural language 16 Nov 2021 · 0 repositories
-
Towards Fully Self-Supervised Learning of Knowledge from Unstructured Text 16 Nov 2021 · 0 repositories
-
Towards Improving Topic Models with the BERT-based Neural Topic Encoder 16 Nov 2021 · 0 repositories
-
Understanding Attention in Machine Reading Comprehension 16 Nov 2021 · 0 repositories
-
UNICON: Unsupervised Intent Discovery via Semantic-level Contrastive Learning 16 Nov 2021 · 0 repositories
-
Unsupervised multiple-choice question generation for out-of-domain Q&A fine-tuning 16 Nov 2021 · 0 repositories
-
Weight Squeezing: Reparameterization for Knowledge Transfer and Model Compression 16 Nov 2021 · 0 repositories
-
When classifying grammatical role, BERT doesn't care about word order... except when it matters 16 Nov 2021 · 0 repositories
-
Assessing gender bias in medical and scientific masked language models with StereoSet 15 Nov 2021 · 0 repositories · arXiv:2111.08088