Methods › General › Learning Rate Schedules › Linear Warmup With Linear Decay › Papers, page 60
Linear Warmup With Linear Decay
Papers archive 2025-07-28
archive papers tagged: 7,076 · with a code link: 2,913 · where Syntology ran a sample: 650 (531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (650 of 7,076 tagged: 531 with a run with no instrument failure, 119 where every run was a failure of Syntology's instrument)
Page 60 of 71: papers 5,901 to 6,000 of 7,076, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Jointly Fine-Tuning “BERT-like” Self Supervised Models to Improve Multimodal Speech Emotion Recognition 15 Aug 2020 · 1 repository
-
Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT model 14 Aug 2020 · 0 repositories · arXiv:2008.06460
-
ANDES at SemEval-2020 Task 12: A jointly-trained BERT multilingual model for offensive language detection 13 Aug 2020 · 1 repository · arXiv:2008.06408
-
MICE: Mining Idioms with Contextual Embeddings 13 Aug 2020 · 1 repository · arXiv:2008.05759
-
Variance-reduced Language Pretraining via a Mask Proposal Network 12 Aug 2020 · 0 repositories · arXiv:2008.05333
-
Beyond Lexical: A Semantic Retrieval Framework for Textual SearchEngine 10 Aug 2020 · 0 repositories · arXiv:2008.03917
-
On Commonsense Cues in BERT for Solving Commonsense Tasks 10 Aug 2020 · 0 repositories · arXiv:2008.03945
-
FireBERT: Hardening BERT-based classifiers against adversarial attack 10 Aug 2020 · 1 repository · arXiv:2008.04203
-
GANBERT: Generative Adversarial Networks with Bidirectional Encoder Representations from Transformers for MRI to PET synthesis 10 Aug 2020 · 0 repositories · arXiv:2008.04393
-
KR-BERT: A Small-Scale Korean-Specific Language Model 10 Aug 2020 · 1 repository · arXiv:2008.03979
-
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR 9 Aug 2020 · 1 repository · arXiv:2008.03822
-
Fast and Accurate Neural CRF Constituency Parsing 9 Aug 2020 · 2 repositories · arXiv:2008.03736Syntology official (archive's flag): 1 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
SemEval-2020 Task 10: Emphasis Selection for Written Text in Visual Media 7 Aug 2020 · 0 repositories · arXiv:2008.03274
-
aschern at SemEval-2020 Task 11: It Takes Three to Tango: RoBERTa, CRF, and Transfer Learning 6 Aug 2020 · 1 repository · arXiv:2008.02837
-
ConvBERT: Improving BERT with Span-based Dynamic Convolution 6 Aug 2020 · 8 repositories · arXiv:2008.02496
-
DeText: A Deep Text Ranking Framework with BERT 6 Aug 2020 · 1 repository · arXiv:2008.02460Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
I-AID: Identifying Actionable Information from Disaster-related Tweets 4 Aug 2020 · 1 repository · arXiv:2008.13544
-
NLPDove at SemEval-2020 Task 12: Improving Offensive Language Detection with Cross-lingual Transfer 4 Aug 2020 · 1 repository · arXiv:2008.01354
-
Taking Notes on the Fly Helps BERT Pre-training 4 Aug 2020 · 0 repositories · arXiv:2008.01466
-
Improving One-stage Visual Grounding by Recursive Sub-query Construction 3 Aug 2020 · 1 repository · arXiv:2008.01059Syntology official (archive's flag): 20 ran · 20 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 1 honoured, 0 violated, 18 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 22 harvested samples) · 3 pointer-only (licence)
-
LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT? 3 Aug 2020 · 0 repositories · arXiv:2008.00805
-
MusiCoder: A Universal Music-Acoustic Encoder Based on Transformers 3 Aug 2020 · 0 repositories · arXiv:2008.00781
-
Multi-node Bert-pretraining: Cost-efficient Approach 1 Aug 2020 · 0 repositories · arXiv:2008.00177
-
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing 31 Jul 2020 · 2 repositories · arXiv:2007.15779
-
Model Reduction of Shallow CNN Model for Reliable Deployment of Information Extraction from Medical Reports 31 Jul 2020 · 0 repositories · arXiv:2008.01572
-
On Learning Universal Representations Across Languages 31 Jul 2020 · 0 repositories · arXiv:2007.15960
-
Depressive, Drug Abusive, or Informative: Knowledge-aware Study of News Exposure during COVID-19 Outbreak 30 Jul 2020 · 0 repositories · arXiv:2007.15209
-
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering 30 Jul 2020 · 2 repositories · arXiv:2007.15207Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
What does BERT know about books, movies and music? Probing BERT for Conversational Recommendation 30 Jul 2020 · 1 repository · arXiv:2007.15356
-
Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining 29 Jul 2020 · 1 repository · arXiv:2007.14587
-
BUT-FIT at SemEval-2020 Task 5: Automatic detection of counterfactual statements with deep pre-trained language representation models 28 Jul 2020 · 1 repository · arXiv:2007.14128
-
Deep Learning Brasil -- NLP at SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets 28 Jul 2020 · 0 repositories · arXiv:2008.01544
-
GUIR at SemEval-2020 Task 12: Domain-Tuned Contextualized Models for Offensive Language Detection 28 Jul 2020 · 0 repositories · arXiv:2007.14477
-
Improving Results on Russian Sentiment Datasets 28 Jul 2020 · 1 repository · arXiv:2007.14310
-
Variants of BERT, Random Forests and SVM approach for Multimodal Emotion-Target Sub-challenge 28 Jul 2020 · 0 repositories · arXiv:2007.13928
-
Evaluation of Federated Learning in Phishing Email Detection 27 Jul 2020 · 0 repositories · arXiv:2007.13300
-
KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Media 26 Jul 2020 · 1 repository · arXiv:2007.13184Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Reed at SemEval-2020 Task 9: Fine-Tuning and Bag-of-Words Approaches to Code-Mixed Sentiment Analysis 26 Jul 2020 · 0 repositories · arXiv:2007.13061
-
To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detection 26 Jul 2020 · 0 repositories · arXiv:2008.01551
-
MULTISEM at SemEval-2020 Task 3: Fine-tuning BERT for Lexical Meaning 24 Jul 2020 · 1 repository · arXiv:2007.12432
-
Product Title Generation for Conversational Systems using BERT 23 Jul 2020 · 0 repositories · arXiv:2007.11768
-
The Lottery Ticket Hypothesis for Pre-trained BERT Networks 23 Jul 2020 · 2 repositories · arXiv:2007.12223Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 3 pointer-only (licence)
-
IITK at the FinSim Task: Hypernym Detection in Financial Domain via Context-Free and Contextualized Word Embeddings 22 Jul 2020 · 0 repositories · arXiv:2007.11201
-
Multi-task learning for natural language processing in the 2020s: where are we going? 22 Jul 2020 · 0 repositories · arXiv:2007.16008
-
Check_square at CheckThat! 2020: Claim Detection in Social Media via Fusion of Transformer and Syntactic Features 21 Jul 2020 · 1 repository · arXiv:2007.10534
-
Neural Machine Translation with Error Correction 21 Jul 2020 · 1 repository · arXiv:2007.10681
-
newsSweeper at SemEval-2020 Task 11: Context-Aware Rich Feature Representations For Propaganda Classification 21 Jul 2020 · 1 repository · arXiv:2007.10827
-
problemConquero at SemEval-2020 Task 12: Transformer and Soft label-based approaches 21 Jul 2020 · 1 repository · arXiv:2007.10877
-
Understanding BERT Rankers Under Distillation 21 Jul 2020 · 0 repositories · arXiv:2007.11088
-
Word Representation for Rhythms 21 Jul 2020 · 1 repository · arXiv:2007.10610
-
A Comparison of Supervised Learning to Match Methods for Product Search 20 Jul 2020 · 1 repository · arXiv:2007.10296
-
Mono vs Multilingual Transformer-based Models: a Comparison across Several Language Tasks 19 Jul 2020 · 1 repository · arXiv:2007.09757
-
Multi-Perspective Semantic Information Retrieval in the Biomedical Domain 17 Jul 2020 · 0 repositories · arXiv:2008.01526
-
Hopfield Networks is All You Need 16 Jul 2020 · 3 repositories · arXiv:2008.02217Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
-
Towards Debiasing Sentence Representations 16 Jul 2020 · 1 repository · arXiv:2007.08100Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Translate Reverberated Speech to Anechoic Ones: Speech Dereverberation with BERT 16 Jul 2020 · 0 repositories · arXiv:2007.08052
-
AdapterHub: A Framework for Adapting Transformers 15 Jul 2020 · 9 repositories · arXiv:2007.07779Syntology official (archive's flag): 1 ran · 11 ran (of which 2 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 15 harvested samples) · 12 pointer-only (licence)
-
Deep Reinforced Query Reformulation for Information Retrieval 15 Jul 2020 · 0 repositories · arXiv:2007.07987
-
Fine-Tune Longformer for Jointly Predicting Rumor Stance and Veracity 15 Jul 2020 · 0 repositories · arXiv:2007.07803
-
Logic Constrained Pointer Networks for Interpretable Textual Similarity 15 Jul 2020 · 1 repository · arXiv:2007.07670
-
Multimodal Word Sense Disambiguation in Creative Practice 15 Jul 2020 · 1 repository · arXiv:2007.07758
-
Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media 15 Jul 2020 · 3 repositories · arXiv:2007.07997
-
Predicting Clinical Diagnosis from Patients Electronic Health Records Using BERT-based Neural Networks 15 Jul 2020 · 0 repositories · arXiv:2007.07562
-
Add a SideNet to your MainNet 14 Jul 2020 · 0 repositories · arXiv:2007.13512
-
An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models 14 Jul 2020 · 1 repository · arXiv:2007.06778
-
Can neural networks acquire a structural bias from raw linguistic data? 14 Jul 2020 · 0 repositories · arXiv:2007.06761
-
Emoji Prediction: Extensions and Benchmarking 14 Jul 2020 · 1 repository · arXiv:2007.07389
-
Optimizing Memory Placement using Evolutionary Graph Reinforcement Learning 14 Jul 2020 · 0 repositories · arXiv:2007.07298
-
What's in a Name? Are BERT Named Entity Representations just as Good for any other Name? 14 Jul 2020 · 0 repositories · arXiv:2007.06897
-
An Enhanced Text Classification to Explore Health based Indian Government Policy Tweets 13 Jul 2020 · 0 repositories · arXiv:2007.06511
-
BERT Learns (and Teaches) Chemistry 11 Jul 2020 · 0 repositories · arXiv:2007.16012
-
Generative Compositional Augmentations for Scene Graph Prediction 11 Jul 2020 · 1 repository · arXiv:2007.05756
-
GLOW : Global Weighted Self-Attention Network for Web Search 10 Jul 2020 · 1 repository · arXiv:2007.05186
-
Multi-Dialect Arabic BERT for Country-Level Dialect Identification 10 Jul 2020 · 1 repository · arXiv:2007.05612
-
To BAN or not to BAN: Bayesian Attention Networks for Reliable Hate Speech Detection 10 Jul 2020 · 0 repositories · arXiv:2007.05304
-
Contrastive Code Representation Learning 9 Jul 2020 · 1 repository · arXiv:2007.04973
-
Fast Transformers with Clustered Attention 9 Jul 2020 · 1 repository · arXiv:2007.04825
-
Continual BERT: Continual Learning for Adaptive Extractive Summarization of COVID-19 Literature 7 Jul 2020 · 1 repository · arXiv:2007.03405
-
Pre-Trained Models for Heterogeneous Information Networks 7 Jul 2020 · 0 repositories · arXiv:2007.03184
-
Deep Contextual Embeddings for Address Classification in E-commerce 6 Jul 2020 · 0 repositories · arXiv:2007.03020
-
Robust Prediction of Punctuation and Truecasing for Medical ASR 4 Jul 2020 · 0 repositories · arXiv:2007.02025
-
Text Data Augmentation: Towards better detection of spear-phishing emails 4 Jul 2020 · 0 repositories · arXiv:2007.02033
-
Language-agnostic BERT Sentence Embedding 3 Jul 2020 · 6 repositories · arXiv:2007.01852
-
MIRA: Leveraging Multi-Intention Co-click Information in Web-scale Document Retrieval using Deep Neural Networks 3 Jul 2020 · 0 repositories · arXiv:2007.01510
-
Playing with Words at the National Library of Sweden -- Making a Swedish BERT 3 Jul 2020 · 1 repository · arXiv:2007.01658
-
Pretrained Semantic Speech Embeddings for End-to-End Spoken Language Understanding via Cross-Modal Teacher-Student Learning 3 Jul 2020 · 0 repositories · arXiv:2007.01836
-
Reading Comprehension in Czech via Machine Translation and Cross-lingual Transfer 3 Jul 2020 · 0 repositories · arXiv:2007.01667
-
Bidirectional Encoder Representations from Transformers (BERT): A sentiment analysis odyssey 2 Jul 2020 · 0 repositories · arXiv:2007.01127
-
Detecting Ongoing Events Using Contextual Word and Sentence Embeddings 2 Jul 2020 · 0 repositories · arXiv:2007.01379
-
The Impact of Explanations on AI Competency Prediction in VQA 2 Jul 2020 · 0 repositories · arXiv:2007.00900
-
A BERT-based One-Pass Multi-Task Model for Clinical Temporal Relation Extraction 1 Jul 2020 · 0 repositories
-
A Generate-and-Rank Framework with Semantic Type Regularization for Biomedical Concept Normalization 1 Jul 2020 · 0 repositories
-
A Metric Learning Approach to Misogyny Categorization 1 Jul 2020 · 0 repositories
-
A Simple and Effective Dependency Parser for Telugu 1 Jul 2020 · 0 repositories
-
A Transformer Approach to Contextual Sarcasm Detection in Twitter 1 Jul 2020 · 0 repositories
-
Adversarial and Domain-Aware BERT for Cross-Domain Sentiment Analysis 1 Jul 2020 · 0 repositories
-
Adversarial Evaluation of BERT for Biomedical Named Entity Recognition 1 Jul 2020 · 0 repositories
-
Automatic Generation of Citation Texts in Scholarly Papers: A Pilot Study 1 Jul 2020 · 0 repositories
-
Character aware models with similarity learning for metaphor detection 1 Jul 2020 · 0 repositories
-
Context-Aware Sarcasm Detection Using BERT 1 Jul 2020 · 0 repositories