Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 31

Linear Warmup With Linear Decay

Papers archive 2025-07-28

archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)

Page 31 of 71: papers 3,001 to 3,100 of 7,076, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Semantic Importance-Aware Communications Using Pre-trained Language Models
  12 Feb 2023 · 0 repositories · arXiv:2302.07142
• Transformer models: an introduction and catalog
  12 Feb 2023 · 0 repositories · arXiv:2302.07730
• DocILE Benchmark for Document Information Localization and Extraction
  11 Feb 2023 · 1 repository · arXiv:2302.05658
• Informing clinical assessment by contextualizing post-hoc explanations of risk prediction models in type-2 diabetes
  11 Feb 2023 · 0 repositories · arXiv:2302.05752
• Alloprof: a new French question-answer education dataset and its use in an information retrieval case study
  10 Feb 2023 · 1 repository · arXiv:2302.07738
• BEST: BERT Pre-Training for Sign Language Recognition with Coupling Tokenization
  10 Feb 2023 · 0 repositories · arXiv:2302.05075
• FairPy: A Toolkit for Evaluation of Prediction Biases and their Mitigation in Large Language Models
  10 Feb 2023 · 1 repository · arXiv:2302.05508
• GTR-CTRL: Instrument and Genre Conditioning for Guitar-Focused Music Generation with Transformers
  10 Feb 2023 · 0 repositories · arXiv:2302.05393
• CRL+: A Novel Semi-Supervised Deep Active Contrastive Representation Learning-Based Text Classification Model for Insurance Data
  8 Feb 2023 · 0 repositories · arXiv:2302.04343
• Efficient Joint Learning for Clinical Named Entity Recognition and Relation Extraction Using Fourier Networks: A Use Case in Adverse Drug Events
  8 Feb 2023 · 1 repository · arXiv:2302.04185
• Prompting for Multimodal Hateful Meme Classification
  8 Feb 2023 · 0 repositories · arXiv:2302.04156
• LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
  7 Feb 2023 · 0 repositories · arXiv:2302.03213
• What do Language Models know about word senses? Zero-Shot WSD with Language Models and Domain Inventories
  7 Feb 2023 · 0 repositories · arXiv:2302.03353
• Context-Gloss Augmentation for Improving Arabic Target Sense Verification
  6 Feb 2023 · 0 repositories · arXiv:2302.03126
• cross-modal fusion techniques for utterance-level emotion recognition from text and speech
  5 Feb 2023 · 0 repositories · arXiv:2302.02447
• VuLASTE: Long Sequence Model with Abstract Syntax Tree Embedding for vulnerability Detection
  5 Feb 2023 · 0 repositories · arXiv:2302.02345
• A New cross-domain strategy based XAI models for fake news detection
  4 Feb 2023 · 0 repositories · arXiv:2302.02122
• Knowledge Graph Completion Method Combined With Adaptive Enhanced Semantic Information
  4 Feb 2023 · 0 repositories · arXiv:2302.02116
• ANTM: An Aligned Neural Topic Model for Exploring Evolving Topics
  3 Feb 2023 · 1 repository · arXiv:2302.01501
• Bioformer: an efficient transformer language model for biomedical text mining
  3 Feb 2023 · 1 repository · arXiv:2302.01588
• Detecting Reddit Users with Depression Using a Hybrid Neural Network SBERT-CNN
  3 Feb 2023 · 0 repositories · arXiv:2302.02759
• Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective
  3 Feb 2023 · 1 repository · arXiv:2302.01530
• Towards Few-Shot Identification of Morality Frames using In-Context Learning
  3 Feb 2023 · 0 repositories · arXiv:2302.02029
• Language Quantized AutoEncoders: Towards Unsupervised Text-Image Alignment
  2 Feb 2023 · 1 repository · arXiv:2302.00902
• Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs
  2 Feb 2023 · 1 repository · arXiv:2302.00901
• Mnemosyne: Learning to Train Transformers with Transformers
  2 Feb 2023 · 0 repositories · arXiv:2302.01128
• Resilient Binary Neural Network
  2 Feb 2023 · 1 repository · arXiv:2302.00956
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning
  1 Feb 2023 · 0 repositories · arXiv:2302.00378
• The Touché23-ValueEval Dataset for Identifying Human Values behind Arguments
  31 Jan 2023 · 1 repository · arXiv:2301.13771
• CSDR-BERT: a pre-trained scientific dataset match model for Chinese Scientific Dataset Retrieval
  30 Jan 2023 · 0 repositories · arXiv:2301.12700
• Representation biases in sentence transformers
  30 Jan 2023 · 0 repositories · arXiv:2301.13039
• BERT-based Authorship Attribution on the Romanian Dataset called ROST
  29 Jan 2023 · 0 repositories · arXiv:2301.12500
• Global Flood Prediction: a Multimodal Machine Learning Approach
  29 Jan 2023 · 0 repositories · arXiv:2301.12548
• Semantic Tagging with LSTM-CRF
  28 Jan 2023 · 0 repositories · arXiv:2301.12206
• A Comparative Study of Pretrained Language Models for Long Clinical Text
  27 Jan 2023 · 1 repository · arXiv:2301.11847
• A Multi-View Joint Learning Framework for Embedding Clinical Codes and Text Using Graph Neural Networks
  27 Jan 2023 · 0 repositories · arXiv:2301.11608
• Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
  27 Jan 2023 · 0 repositories · arXiv:2301.11688
• Context Matters: A Strategy to Pre-train Language Model for Science Education
  27 Jan 2023 · 0 repositories · arXiv:2301.12031
• Predicting Sentence-Level Factuality of News and Bias of Media Outlets
  27 Jan 2023 · 1 repository · arXiv:2301.11850
• Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases
  27 Jan 2023 · 1 repository · arXiv:2301.12017
• A benchmark for toxic comment classification on Civil Comments dataset
  26 Jan 2023 · 1 repository · arXiv:2301.11125
• BERT-Embedding and Citation Network Analysis based Query Expansion Technique for Scholarly Search
  26 Jan 2023 · 0 repositories · arXiv:2301.11069
• A Stability Analysis of Fine-Tuning a Pre-Trained Model
  24 Jan 2023 · 0 repositories · arXiv:2301.09820
• Multitask Instruction-based Prompting for Fallacy Recognition
  24 Jan 2023 · 0 repositories · arXiv:2301.09992
• Injecting the BM25 Score as Text Improves BERT-Based Re-rankers
  23 Jan 2023 · 1 repository · arXiv:2301.09728
• StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Series
  23 Jan 2023 · 2 repositories · arXiv:2301.09279
• Stress Test for BERT and Deep Models: Predicting Words from Italian Poetry
  21 Jan 2023 · 0 repositories · arXiv:2302.09303
• Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions
  20 Jan 2023 · 2 repositories · arXiv:2301.08810
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
• Which Features are Learned by CodeBert: An Empirical Study of the BERT-based Source Code Representation Learning
  20 Jan 2023 · 0 repositories · arXiv:2301.08427
• An Error-Guided Correction Model for Chinese Spelling Error Correction
  16 Jan 2023 · 1 repository · arXiv:2301.06323
• TEDB System Description to a Shared Task on Euphemism Detection 2022
  16 Jan 2023 · 1 repository · arXiv:2301.06602
• Improving Noise Robustness for Spoken Content Retrieval using Semi-supervised ASR and N-best Transcripts for BERT-based Ranking Models
  15 Jan 2023 · 0 repositories · arXiv:2301.06056
• NarrowBERT: Accelerating Masked Language Model Pretraining and Inference
  11 Jan 2023 · 1 repository · arXiv:2301.04761
  Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Topics in Contextualised Attention Embeddings
  11 Jan 2023 · 0 repositories · arXiv:2301.04339
• Language Models sounds the Death Knell of Knowledge Graphs
  10 Jan 2023 · 0 repositories · arXiv:2301.03980
• Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling
  9 Jan 2023 · 2 repositories · arXiv:2301.03580
  Syntology official (archive's flag): 9 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples) · 2 pointer-only (licence)
• Online Fake Review Detection Using Supervised Machine Learning And BERT Model
  9 Jan 2023 · 0 repositories · arXiv:2301.03225
• App Review Driven Collaborative Bug Finding
  7 Jan 2023 · 1 repository · arXiv:2301.02818
• RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm
  7 Jan 2023 · 0 repositories · arXiv:2301.02807
• Learning Trajectory-Word Alignments for Video-Language Tasks
  5 Jan 2023 · 0 repositories · arXiv:2301.01953
• PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora
  3 Jan 2023 · 0 repositories · arXiv:2301.01064
• Understanding Political Polarisation using Language Models: A dataset and method
  2 Jan 2023 · 0 repositories · arXiv:2301.00891
• Floods Relevancy and Identification of Location from Twitter Posts using NLP Techniques
  1 Jan 2023 · 0 repositories · arXiv:2301.00321
• Leveraging Semantic Representations Combined with Contextual Word Representations for Recognizing Textual Entailment in Vietnamese
  1 Jan 2023 · 0 repositories · arXiv:2301.00422
• Sentiment Analysis of COVID-19 Public Activity Restriction (PPKM) Impact using BERT Method
  31 Dec 2022 · 0 repositories · arXiv:2301.00096
• An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models
  30 Dec 2022 · 0 repositories · arXiv:2212.14852
• Distant Reading of the German Coalition Deal: Recognizing Policy Positions with BERT-based Text Classification
  30 Dec 2022 · 0 repositories · arXiv:2212.14648
• Cramming: Training a Language Model on a Single GPU in One Day
  28 Dec 2022 · 1 repository · arXiv:2212.14034
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• A Survey on Knowledge-Enhanced Pre-trained Language Models
  27 Dec 2022 · 0 repositories · arXiv:2212.13428
• Benchmark for Uncertainty & Robustness in Self-Supervised Learning
  23 Dec 2022 · 1 repository · arXiv:2212.12411
• Finetuning for Sarcasm Detection with a Pruned Dataset
  23 Dec 2022 · 1 repository · arXiv:2212.12213
• CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT
  22 Dec 2022 · 0 repositories · arXiv:2212.11456
• Enhancing the prediction of disease outcomes using electronic health records and pretrained deep learning models
  22 Dec 2022 · 0 repositories · arXiv:2212.12067
• Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering
  21 Dec 2022 · 1 repository · arXiv:2212.10696
• Automatic Emotion Modelling in Written Stories
  21 Dec 2022 · 1 repository · arXiv:2212.11382
• Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?
  21 Dec 2022 · 1 repository · arXiv:2212.10879
• Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks
  21 Dec 2022 · 0 repositories · arXiv:2212.10774
• A Twitter BERT Approach for Offensive Language Detection in Marathi
  20 Dec 2022 · 0 repositories · arXiv:2212.10039
• Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learning
  20 Dec 2022 · 0 repositories · arXiv:2212.10087
• Identifying and Manipulating the Personality Traits of Language Models
  20 Dec 2022 · 0 repositories · arXiv:2212.10276
• In and Out-of-Domain Text Adversarial Robustness via Label Smoothing
  20 Dec 2022 · 0 repositories · arXiv:2212.10258
• Parameter-efficient Zero-shot Transfer for Cross-Language Dense Retrieval with Adapters
  20 Dec 2022 · 0 repositories · arXiv:2212.10448
• Pretraining Without Attention
  20 Dec 2022 · 1 repository · arXiv:2212.10544
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?
  19 Dec 2022 · 1 repository · arXiv:2212.09747
• Enriching Relation Extraction with OpenIE
  19 Dec 2022 · 0 repositories · arXiv:2212.09376
• Less is More: Parameter-Free Text Classification with Gzip
  19 Dec 2022 · 0 repositories · arXiv:2212.09410
• MANTIS at TSAR-2022 Shared Task: Improved Unsupervised Lexical Simplification with Pretrained Encoders
  19 Dec 2022 · 0 repositories · arXiv:2212.09855
• Bort: Towards Explainable Neural Networks with Bounded Orthogonal Constraint
  18 Dec 2022 · 1 repository · arXiv:2212.09062
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Neural Coreference Resolution based on Reinforcement Learning
  18 Dec 2022 · 0 repositories · arXiv:2212.09028
• Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search
  18 Dec 2022 · 0 repositories · arXiv:2212.09017
• Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis
  17 Dec 2022 · 0 repositories · arXiv:2212.08888
• LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension
  16 Dec 2022 · 0 repositories · arXiv:2212.08204
• Plansformer: Generating Symbolic Plans using Transformers
  16 Dec 2022 · 0 repositories · arXiv:2212.08681
• POIBERT: A Transformer-based Model for the Tour Recommendation Problem
  16 Dec 2022 · 0 repositories · arXiv:2212.13900
• ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks
  16 Dec 2022 · 1 repository · arXiv:2212.08322
  Syntology official (archive's flag): 4 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• Utilizing distilBert transformer model for sentiment classification of COVID-19's Persian open-text responses
  16 Dec 2022 · 0 repositories · arXiv:2212.08407
• Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking
  15 Dec 2022 · 1 repository · arXiv:2212.07617
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Visually-augmented pretrained language models for NLP tasks without images
  15 Dec 2022 · 1 repository · arXiv:2212.07937
• Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
  14 Dec 2022 · 5 repositories · arXiv:2212.07525
  Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 2 pointer-only (licence)
• Explainability of Text Processing and Retrieval Methods: A Critical Survey
  14 Dec 2022 · 0 repositories · arXiv:2212.07126