Methods › General › Large Batch Optimization › LARS
LARS
Introduced by Yang You et al. in Large Batch Training of Convolutional Networks
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Layer-wise Adaptive Rate Scaling, or LARS, is a large batch optimization technique. There are two notable differences between LARS and other adaptive algorithms such as Adam or RMSProp: first, LARS uses a separate learning rate for each layer and not for each weight. And second, the magnitude of the update is controlled with respect to the weight norm for better control of training speed.
mₜ = β₁mₜ₋₁ + (1-β₁)(gₜ + λxₜ) xₜ₊₁⁽ⁱ⁾ = xₜ⁽ⁱ⁾ - ηₜ(ϕ(|| xₜ⁽ⁱ⁾ ||))/(|| mₜ⁽ⁱ⁾ ||)mₜ⁽ⁱ⁾
Papers archive 2025-07-28
30 shown of 77, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Analyzing Breast Cancer Survival Disparities by Race and Demographic Location: A Survival Analysis Approach 8 Jun 2025 · 0 repositories · arXiv:2506.07191
-
Enhancing Federated Survival Analysis through Peer-Driven Client Reputation in Healthcare 22 May 2025 · 0 repositories · arXiv:2505.16190
-
Is Self-Supervised Pre-training on Satellite Imagery Better than ImageNet? A Systematic Study with Sentinel-2 15 Feb 2025 · 0 repositories · arXiv:2502.10669
-
Self-Supervised Frameworks for Speaker Verification via Bootstrapped Positive Sampling 29 Jan 2025 · 1 repository · arXiv:2501.17772
-
Tackling Small Sample Survival Analysis via Transfer Learning: A Study of Colorectal Cancer Prognosis 21 Jan 2025 · 1 repository · arXiv:2501.12421
-
Prediction of Lung Metastasis from Hepatocellular Carcinoma using the SEER Database 20 Jan 2025 · 1 repository · arXiv:2501.11720
-
Diagnosis and Severity Assessment of Ulcerative Colitis using Self Supervised Learning 9 Dec 2024 · 0 repositories · arXiv:2412.07806
-
SEER: Self-Aligned Evidence Extraction for Retrieval-Augmented Generation 15 Oct 2024 · 0 repositories · arXiv:2410.11315
-
The Informed Elastic Net for Fast Grouped Variable Selection and FDR Control in Genomics Research 7 Oct 2024 · 0 repositories · arXiv:2410.05211
-
Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs 17 Jun 2024 · 0 repositories · arXiv:2406.11278
-
Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation 29 May 2024 · 0 repositories · arXiv:2405.18688
-
Self-Supervised Multiple Instance Learning for Acute Myeloid Leukemia Classification 8 Mar 2024 · 0 repositories · arXiv:2403.05379
-
SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning 24 Jan 2024 · 1 repository · arXiv:2401.13246Syntology ran 13 of 16 samples · 3 unverified · 1 pointer-only (licence)
-
Survival Analysis of Young Triple-Negative Breast Cancer Patients 15 Jan 2024 · 0 repositories · arXiv:2401.08712
-
Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing 11 Jan 2024 · 0 repositories · arXiv:2401.05730
-
Quantum Algorithms for the Pathwise Lasso 21 Dec 2023 · 0 repositories · arXiv:2312.14141
-
Feature Extraction for Generative Medical Imaging Evaluation: New Evidence Against an Evolving Trend 22 Nov 2023 · 2 repositories · arXiv:2311.13717
-
SEER : A Knapsack approach to Exemplar Selection for In-Context HybridQA 10 Oct 2023 · 1 repository · arXiv:2310.06675Syntology ran 6 of 16 samples · 10 unverified
-
Revisiting LARS for Large Batch Training Generalization of Neural Networks 25 Sep 2023 · 0 repositories · arXiv:2309.14053
-
Accelerating Large Batch Training via Gradient Signal to Noise Ratio (GSNR) 24 Sep 2023 · 0 repositories · arXiv:2309.13681
-
SEER: Super-Optimization Explorer for HLS using E-graph Rewriting with MLIR 15 Aug 2023 · 0 repositories · arXiv:2308.07654
-
The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning 20 Jul 2023 · 1 repository · arXiv:2307.10907Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
-
Semi-supervised learning made simple with self-supervised clustering 13 Jun 2023 · 1 repository · arXiv:2306.07483Syntology ran 2 of 5 samples · 3 unverified · 5 pointer-only (licence)
-
Hiding in Plain Sight: Disguising Data Stealing Attacks in Federated Learning 5 Jun 2023 · 2 repositories · arXiv:2306.03013
-
Using Spatio-Temporal Dual-Stream Network with Self-Supervised Learning for Lung Tumor Classification on Radial Probe Endobronchial Ultrasound Video 4 May 2023 · 0 repositories · arXiv:2305.02719
-
In-Distribution and Out-of-Distribution Self-supervised ECG Representation Learning for Arrhythmia Detection 13 Apr 2023 · 0 repositories · arXiv:2304.06427
-
Saddle-to-Saddle Dynamics in Diagonal Linear Networks 2 Apr 2023 · 0 repositories · arXiv:2304.00488
-
Towards domain-invariant Self-Supervised Learning with Batch Styles Standardization 10 Mar 2023 · 0 repositories · arXiv:2303.06088
-
InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning 8 Mar 2023 · 1 repository · arXiv:2303.04947Syntology ran 0 of 2 samples · 2 unverified · 2 pointer-only (licence)
-
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism 4 Mar 2023 · 1 repository · arXiv:2303.02387Syntology ran 2 of 2 samples · 0 unverified
Tasks archive 2025-07-28
20 shown of 106 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections