Methods › General › Stochastic Optimization › AdamW › Papers, page 2
AdamW
Papers archive 2025-07-28
archive papers tagged: 206 · with a code link: 114 · where Syntology ran a sample: 43 (38 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (43 of 206 tagged: 38 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument)
Page 2 of 3: papers 101 to 200 of 206, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Llama 2: Open Foundation and Fine-Tuned Chat Models 18 Jul 2023 · 19 repositories · arXiv:2307.09288Syntology community repositories only · 33 ran (of which 7 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 1 violated, 20 with no contract checked; 11 where Syntology's instrument failed) · 19 unverified (of 52 harvested samples) · 20 pointer-only (licence)
-
NOWJ at COLIEE 2023 -- Multi-Task and Ensemble Approaches in Legal Information Processing 8 Jun 2023 · 0 repositories · arXiv:2306.04903
-
Using Sequences of Life-events to Predict Human Lives 5 Jun 2023 · 2 repositories · arXiv:2306.03009
-
MultiLegalPile: A 689GB Multilingual Legal Corpus 3 Jun 2023 · 0 repositories · arXiv:2306.02069
-
Improving Energy Conserving Descent for Machine Learning: Theory and Practice 1 Jun 2023 · 1 repository · arXiv:2306.00352
-
Incorporating Distributions of Discourse Structure for Long Document Abstractive Summarization 26 May 2023 · 0 repositories · arXiv:2305.16784
-
Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks 26 May 2023 · 2 repositories · arXiv:2305.17212Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
XGrad: Boosting Gradient-Based Optimizers With Weight Prediction 26 May 2023 · 1 repository · arXiv:2305.18240
-
Neural Summarization of Electronic Health Records 24 May 2023 · 0 repositories · arXiv:2305.15222
-
Layer-wise Adaptive Step-Sizes for Stochastic First-Order Methods for Deep Learning 23 May 2023 · 0 repositories · arXiv:2305.13664
-
Text Is All You Need: Learning Language Representations for Sequential Recommendation 23 May 2023 · 1 repository · arXiv:2305.13731Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
A General-Purpose Multilingual Document Encoder 11 May 2023 · 1 repository · arXiv:2305.07016
-
GAANet: Ghost Auto Anchor Network for Detecting Varying Size Drones in Dark 5 May 2023 · 1 repository · arXiv:2305.03425
-
Predicting COVID-19 and pneumonia complications from admission texts 5 May 2023 · 0 repositories · arXiv:2305.03661
-
Leveraging BERT Language Model for Arabic Long Document Classification 4 May 2023 · 0 repositories · arXiv:2305.03519
-
Unlimiformer: Long-Range Transformers with Unlimited Length Input 2 May 2023 · 2 repositories · arXiv:2305.01625Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Customized Segment Anything Model for Medical Image Segmentation 26 Apr 2023 · 1 repository · arXiv:2304.13785Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 4 pointer-only (licence)
-
Stable and low-precision training for large-scale vision-language models 25 Apr 2023 · 1 repository · arXiv:2304.13013Syntology official: harvested for another paper · 0 ran · 3 unverified (of 3 harvested samples)
-
Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health 20 Apr 2023 · 0 repositories · arXiv:2304.10447
-
Stochastic Parrots Looking for Stochastic Parrots: LLMs are Easy to Fine-Tune and Hard to Detect with other LLMs 18 Apr 2023 · 1 repository · arXiv:2304.08968
-
Multi-class Categorization of Reasons behind Mental Disturbance in Long Texts 8 Apr 2023 · 0 repositories · arXiv:2304.04118
-
Lipschitzness Effect of a Loss Function on Generalization Performance of Deep Neural Networks Trained by Adam and AdamW Optimizers 29 Mar 2023 · 0 repositories · arXiv:2303.16464
-
Finding the Needle in a Haystack: Unsupervised Rationale Extraction from Long Text Classifiers 14 Mar 2023 · 0 repositories · arXiv:2303.07991
-
Is In-hospital Meta-information Useful for Abstractive Discharge Summary Generation? 10 Mar 2023 · 0 repositories · arXiv:2303.06002
-
Searching for Effective Neural Network Architectures for Heart Murmur Detection from Phonocardiogram 6 Mar 2023 · 1 repository · arXiv:2303.02988
-
Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization 3 Mar 2023 · 1 repository · arXiv:2303.03108
-
Clinical BioBERT Hyperparameter Optimization using Genetic Algorithm 8 Feb 2023 · 0 repositories · arXiv:2302.03822
-
VuLASTE: Long Sequence Model with Abstract Syntax Tree Embedding for vulnerability Detection 5 Feb 2023 · 0 repositories · arXiv:2302.02345
-
Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs 2 Feb 2023 · 1 repository · arXiv:2302.00901
-
Weight Prediction Boosts the Convergence of AdamW 1 Feb 2023 · 0 repositories · arXiv:2302.00195
-
A Comparative Study of Pretrained Language Models for Long Clinical Text 27 Jan 2023 · 1 repository · arXiv:2301.11847
-
Read the Signs: Towards Invariance to Gradient Descent's Hyperparameter Initialization 24 Jan 2023 · 1 repository · arXiv:2301.10133
-
Development, Optimization, and Deployment of Thermal Forward Vision Systems for Advance Vehicular Applications on Edge Devices 18 Jan 2023 · 1 repository · arXiv:2301.07613
-
A Stochastic Proximal Polyak Step Size 12 Jan 2023 · 1 repository · arXiv:2301.04935Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Grokking modular arithmetic 6 Jan 2023 · 1 repository · arXiv:2301.02679
-
MoBYv2AL: Self-supervised Active Learning for Image Classification 4 Jan 2023 · 1 repository · arXiv:2301.01531
-
Understanding Political Polarisation using Language Models: A dataset and method 2 Jan 2023 · 0 repositories · arXiv:2301.00891
-
A General Regret Bound of Preconditioned Gradient Method for DNN Training 1 Jan 2023 · 1 repository
-
Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis 17 Dec 2022 · 0 repositories · arXiv:2212.08888
-
BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch? 30 Nov 2022 · 0 repositories · arXiv:2211.17135
-
How to Fine-Tune Vision Models with SGD 17 Nov 2022 · 0 repositories · arXiv:2211.09359
-
On the Algorithmic Stability and Generalization of Adaptive Optimization Methods 8 Nov 2022 · 0 repositories · arXiv:2211.03970
-
Towards Fast Single-Trial Online ERP based Brain-Computer Interface using dry EEG electrodes and neural networks: a pilot study 4 Nov 2022 · 2 repositories · arXiv:2211.10352
-
Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformer 2 Nov 2022 · 0 repositories · arXiv:2211.00974
-
ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the US 1 Nov 2022 · 1 repository · arXiv:2211.00582
-
How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling 25 Oct 2022 · 1 repository · arXiv:2211.07713
-
Amos: An Adam-style Optimizer with Adaptive Weight Decay towards Model-Oriented Scale 21 Oct 2022 · 1 repository · arXiv:2210.11693Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples)
-
LittleBird: Efficient Faster & Longer Transformer for Question Answering 21 Oct 2022 · 0 repositories · arXiv:2210.11870
-
iDNA-ABF: multi-scale deep biological language learning model for the interpretable prediction of DNA methylations 17 Oct 2022 · 2 repositories
-
Multi-granularity Argument Mining in Legal Texts 17 Oct 2022 · 0 repositories · arXiv:2210.09472
-
An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification 11 Oct 2022 · 0 repositories · arXiv:2210.05529
-
Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding 7 Oct 2022 · 1 repository · arXiv:2210.03304Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
NAG-GS: Semi-Implicit, Accelerated and Robust Stochastic Optimizer 29 Sep 2022 · 2 repositories · arXiv:2209.14937Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
Deep learning and machine learning for Malaria detection: overview, challenges and future directions 27 Sep 2022 · 0 repositories · arXiv:2209.13292
-
Code Comment Inconsistency Detection with BERT and Longformer 29 Jul 2022 · 1 repository · arXiv:2207.14444
-
SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences 29 Jun 2022 · 0 repositories · arXiv:2206.14550
-
Persian Natural Language Inference: A Meta-learning approach 18 May 2022 · 1 repository · arXiv:2205.08755
-
Sequencer: Deep LSTM for Image Classification 4 May 2022 · 5 repositories · arXiv:2205.01972Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples)
-
Abstractive summarization of hospitalisation histories with transformer networks 5 Apr 2022 · 0 repositories · arXiv:2204.02208
-
Surrogate Gap Minimization Improves Sharpness-Aware Training 15 Mar 2022 · 2 repositories · arXiv:2203.08065
-
The NLP Task Effectiveness of Long-Range Transformers 16 Feb 2022 · 0 repositories · arXiv:2202.07856
-
Understanding AdamW through Proximal Methods and Scale-Freeness 31 Jan 2022 · 1 repository · arXiv:2202.00089Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences 27 Jan 2022 · 1 repository · arXiv:2201.11838
-
Hierarchical Neural Network Approaches for Long Document Classification 18 Jan 2022 · 0 repositories · arXiv:2201.06774
-
Simple Local Attentions Remain Competitive for Long-Context Tasks 16 Jan 2022 · 0 repositories
-
A ConvNet for the 2020s 10 Jan 2022 · 54 repositories · arXiv:2201.03545Syntology community repositories only · 57 ran (of which 39 constructed an object rather than computing a result; 49 with no instrument failure: 1 honoured, 0 violated, 48 with no contract checked; 8 where Syntology's instrument failed) · 23 unverified (of 80 harvested samples) · 12 pointer-only (licence)
-
SCROLLS: Standardized CompaRison Over Long Language Sequences 10 Jan 2022 · 2 repositories · arXiv:2201.03533Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
Accelerating Neural Network Optimization Through an Automated Control Theory Lens 1 Jan 2022 · 0 repositories
-
Keyphrase Generation Beyond the Boundaries of Title and Abstract 13 Dec 2021 · 1 repository · arXiv:2112.06776
-
Extending AdamW by Leveraging Its Second Moment and Magnitude 9 Dec 2021 · 0 repositories · arXiv:2112.06125
-
PLSUM: Generating PT-BR Wikipedia by Summarizing Multiple Websites 2 Dec 2021 · 1 repository · arXiv:2112.01591
-
New Approaches to Long Document Summarization: Fourier Transform Based Attention in a Transformer Model 25 Nov 2021 · 0 repositories · arXiv:2111.15473
-
MarCQAp: Effective Context Modeling for Conversational Question Answering 16 Nov 2021 · 0 repositories
-
PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization 16 Oct 2021 · 3 repositories · arXiv:2110.08499Syntology official (archive's flag): 4 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
-
An Exploratory Study on Long Dialogue Summarization: What Works and What's Next 10 Sep 2021 · 1 repository · arXiv:2109.04609
-
BumbleBee: A Transformer for Music 7 Jul 2021 · 0 repositories · arXiv:2107.03443
-
Efficient Transformer for Direct Speech Translation 7 Jul 2021 · 0 repositories · arXiv:2107.03069
-
What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition 5 Jul 2021 · 1 repository · arXiv:2107.02294
-
Ranger21: a synergistic deep learning optimizer 25 Jun 2021 · 2 repositories · arXiv:2106.13731
-
Self-Supervised Document Similarity Ranking via Contextualized Language Models and Hierarchical Inference 2 Jun 2021 · 1 repository · arXiv:2106.01186
-
CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding 23 May 2021 · 1 repository · arXiv:2105.10912
-
Self-Supervised Learning with Swin Transformers 10 May 2021 · 6 repositories · arXiv:2105.04553
-
NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer 8 May 2021 · 0 repositories · arXiv:2105.03775
-
Text Guide: Improving the quality of long text classification by a text selection method based on feature importance 15 Apr 2021 · 1 repository · arXiv:2104.07225
-
NLQuAD: A Non-Factoid Long Question Answering Data Set 1 Apr 2021 · 1 repository
-
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding 29 Mar 2021 · 3 repositories · arXiv:2103.15358Syntology official (archive's flag): 3 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 2 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
A Practical Survey on Faster and Lighter Transformers 26 Mar 2021 · 0 repositories · arXiv:2103.14636
-
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows 25 Mar 2021 · 80 repositories · arXiv:2103.14030Syntology official: harvested, nothing ran · 123 ran (of which 45 constructed an object rather than computing a result; 82 with no instrument failure: 5 honoured, 2 violated, 75 with no contract checked; 41 where Syntology's instrument failed) · 84 unverified (of 207 harvested samples) · 45 pointer-only (licence)
-
Identifying Machine-Paraphrased Plagiarism 22 Mar 2021 · 2 repositories · arXiv:2103.11909
-
Introduction to Neural Transfer Learning with Transformers for Social Science Text Analysis 3 Feb 2021 · 0 repositories · arXiv:2102.02111
-
Grid Search Hyperparameter Benchmarking of BERT, ALBERT, and LongFormer on DuoRC 15 Jan 2021 · 0 repositories · arXiv:2101.06326
-
CDLM: Cross-Document Language Modeling 2 Jan 2021 · 2 repositories · arXiv:2101.00406
-
Training data-efficient image transformers & distillation through attention 23 Dec 2020 · 40 repositories · arXiv:2012.12877Syntology community repositories only · 12 ran (of which 1 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 19 harvested samples) · 3 pointer-only (licence)
-
Pre-training Protein Language Models with Label-Agnostic Binding Pairs Enhances Performance in Downstream Tasks 5 Dec 2020 · 1 repository · arXiv:2012.03084
-
DebateSum: A large-scale argument mining and summarization dataset 14 Nov 2020 · 3 repositories · arXiv:2011.07251Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Longformer for MS MARCO Document Re-ranking Task 20 Sep 2020 · 1 repository · arXiv:2009.09392
-
Efficient Transformers: A Survey 14 Sep 2020 · 0 repositories · arXiv:2009.06732
-
Fine-Tune Longformer for Jointly Predicting Rumor Stance and Veracity 15 Jul 2020 · 0 repositories · arXiv:2007.07803
-
Document Classification for COVID-19 Literature 15 Jun 2020 · 1 repository · arXiv:2006.13816
-
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning 1 Jun 2020 · 4 repositories · arXiv:2006.00719Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples) · 1 pointer-only (licence)