Methods › General › Learning Rate Schedules › Exponential Decay
Exponential Decay
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Exponential Decay is a learning rate schedule where we decay the learning rate with more iterations using an exponential function:
lr = lr₀exp(-kt)
Image Credit: Suki Lau
Papers archive 2025-07-28
30 shown of 110, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
The Debugging Decay Index: Rethinking Debugging Strategies for Code LLMs 23 Jun 2025 · 0 repositories · arXiv:2506.18403
-
Compact Amplified Laser Power Stabilization Using Robust Active Disturbance Rejection Control with Sensor Noise Decoupling 10 Jun 2025 · 0 repositories · arXiv:2506.08404
-
Towards Data-Driven Model-Free Safety-Critical Control 7 Jun 2025 · 0 repositories · arXiv:2506.06931
-
Asymptotically Optimal Linear Best Feasible Arm Identification with Fixed Budget 3 Jun 2025 · 0 repositories · arXiv:2506.02386
-
Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Models 30 May 2025 · 0 repositories · arXiv:2505.24187
-
Continuous-Time Attention: PDE-Guided Mechanisms for Long-Sequence Transformers 27 May 2025 · 0 repositories · arXiv:2505.20666
-
Incremental Attractor Neural Network Modelling of the Lifespan Retrieval Curve 20 Apr 2025 · 0 repositories · arXiv:2504.14528
-
On Oversquashing in Graph Neural Networks Through the Lens of Dynamical Systems 11 Apr 2025 · 1 repository
-
Temporal Model On Quantum Logic 9 Feb 2025 · 0 repositories · arXiv:2502.07817
-
Uniform-in-time weak propagation of chaos for consensus-based optimization 1 Feb 2025 · 0 repositories · arXiv:2502.00582
-
Contextual Online Decision Making with Infinite-Dimensional Functional Regression 30 Jan 2025 · 0 repositories · arXiv:2501.18359
-
Hellinger-Kantorovich Gradient Flows: Global Exponential Decay of Entropy Functionals 28 Jan 2025 · 0 repositories · arXiv:2501.17049
-
The Stabilizer Bootstrap of Quantum Machine Learning with up to 10000 qubits 16 Dec 2024 · 0 repositories · arXiv:2412.11356
-
Modelling Networked Dynamical System by Temporal Graph Neural ODE with Irregularly Partial Observed Time-series Data 29 Nov 2024 · 0 repositories · arXiv:2412.00165
-
Scalable spectral representations for multi-agent reinforcement learning in network MDPs 22 Oct 2024 · 0 repositories · arXiv:2410.17221
-
Nonlinear second-order dynamics describe labial constriction trajectories across languages and contexts 10 Oct 2024 · 0 repositories · arXiv:2410.08351
-
Efficient $1$-bit tensor approximations 2 Oct 2024 · 0 repositories · arXiv:2410.01799
-
Koopman Operator in the Weighted Function Spaces and its Learning for the Estimation of Lyapunov and Zubov Functions 30 Sep 2024 · 0 repositories · arXiv:2410.00223
-
Super Level Sets and Exponential Decay: A Synergistic Approach to Stable Neural Network Training 25 Sep 2024 · 0 repositories · arXiv:2409.16769
-
Quasi-potential and drift decomposition in stochastic systems by sparse identification 10 Sep 2024 · 0 repositories · arXiv:2409.06886
-
From Few to More: Scribble-based Medical Image Segmentation via Masked Context Modeling and Continuous Pseudo Labels 23 Aug 2024 · 0 repositories · arXiv:2408.12814
-
Unsupervised Blind Joint Dereverberation and Room Acoustics Estimation with Diffusion Models 14 Aug 2024 · 0 repositories · arXiv:2408.07472
-
Bridging Smoothness and Approximation: Theoretical Insights into Over-Smoothing in Graph Neural Networks 1 Jul 2024 · 0 repositories · arXiv:2407.01281
-
Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts 24 Jun 2024 · 0 repositories · arXiv:2406.16851
-
Finite Time Analysis of Temporal Difference Learning for Mean-Variance in a Discounted MDP 12 Jun 2024 · 0 repositories · arXiv:2406.07892
-
BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Models 7 May 2024 · 1 repository · arXiv:2405.04272
-
Tackling Graph Oversquashing by Global and Local Non-Dissipativity 2 May 2024 · 0 repositories · arXiv:2405.01009
-
Contextual Categorization Enhancement through LLMs Latent-Space 25 Apr 2024 · 0 repositories · arXiv:2404.16442
-
Gradformer: Graph Transformer with Exponential Decay 24 Apr 2024 · 1 repository · arXiv:2404.15729Syntology ran 6 of 9 samples · 3 unverified · 9 pointer-only (licence)
-
LEMDA: A Novel Feature Engineering Method for Intrusion Detection in IoT Systems 20 Apr 2024 · 0 repositories · arXiv:2404.16870
Tasks archive 2025-07-28
20 shown of 107 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections