Methods › General › Optimization › Lion
Evolved Sign Momentum
Lion
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
The Lion optimizer is discovered by symbolic program search. It is more memory-efficient than most adaptive optimizers as it only needs to momentum. The update of Lion is produced by the sign function.
In Syntology repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: official). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2305.12870) is about this method is not checked.
From the lookup's note on this name: The same name also belongs to “LION”, a method in the paper “LION: Latent Point Diffusion Models for 3D Shape Generation” (arXiv:2210.06978, 733 citations), which the lookup finds cited far more than the paper this answer is about (49 citations), so this answer may be about a different sense of the name. For arXiv:2210.06978: its page on this site · ask the lookup about it.
Origin paper of this answer, arXiv:2305.12870 (its page on this site · its page on Syntology): Syntology's run record for its harvested code, 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 1 pointer-only (licence). The instrument figure counts failures of Syntology's instrument, not of the code. Ran means executed on a synthesized input, not that the code is correct.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 32 · with a code link: 11 · where Syntology ran a sample: 9 (8 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (9 of 32 tagged: 8 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 32 of 32, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Towards Efficient and Effective Alignment of Large Language Models 11 Jun 2025 · 0 repositories · arXiv:2506.09329
-
Lions and Muons: Optimization via Stochastic Frank-Wolfe 4 Jun 2025 · 0 repositories · arXiv:2506.04192
-
Linear Attention for Efficient Bidirectional Sequence Modeling 22 Feb 2025 · 1 repository · arXiv:2502.16249Syntology official (archive's flag): 14 ran · 14 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 0 violated, 1 with no contract checked; 10 where Syntology's instrument failed) · 0 unverified (of 14 harvested samples) · 14 pointer-only (licence)
-
AdaGC: Improving Training Stability for Large Language Model Pretraining 16 Feb 2025 · 0 repositories · arXiv:2502.11034
-
Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants 4 Feb 2025 · 1 repository · arXiv:2502.02431Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
How Memory in Optimization Algorithms Implicitly Modifies the Loss 4 Feb 2025 · 0 repositories · arXiv:2502.02132
-
Grams: Gradient Descent with Adaptive Momentum Scaling 22 Dec 2024 · 1 repository · arXiv:2412.17107Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Lion Cub: Minimizing Communication Overhead in Distributed Lion 25 Nov 2024 · 0 repositories · arXiv:2411.16462
-
MARS: Unleashing the Power of Variance Reduction for Training Large Models 15 Nov 2024 · 2 repositories · arXiv:2411.10438Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 1 pointer-only (licence)
-
Convergence Rate Analysis of LION 12 Nov 2024 · 0 repositories · arXiv:2411.07724
-
TalkMosaic: Interactive PhotoMosaic with Multi-modal LLM Q&A Interactions 20 Sep 2024 · 0 repositories · arXiv:2409.13941
-
Learning Spatially-Aware Language and Audio Embeddings 17 Sep 2024 · 0 repositories · arXiv:2409.11369
-
LION: Linear Group RNN for 3D Object Detection in Point Clouds 25 Jul 2024 · 1 repository · arXiv:2407.18232Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Deconstructing What Makes a Good Optimizer for Language Models 10 Jul 2024 · 0 repositories · arXiv:2407.07972
-
Dynamic Multi-Objective Lion Swarm Optimization with Multi-strategy Fusion: An application in 6R robot trajectory planning 31 May 2024 · 0 repositories · arXiv:2406.00114
-
Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling 23 May 2024 · 0 repositories · arXiv:2405.14578
-
Audio-Visual Speech Recognition based on Regulated Transformer and Spatio-Temporal Fusion Strategy for Driver Assistive Systems 9 May 2024 · 1 repository
-
Communication Efficient Distributed Training with Distributed Lion 30 Mar 2024 · 0 repositories · arXiv:2404.00438
-
FedLion: Faster Adaptive Federated Optimization with Fewer Communication 15 Feb 2024 · 1 repository · arXiv:2402.09941Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
MADA: Meta-Adaptive Optimizers through hyper-gradient Descent 17 Jan 2024 · 0 repositories · arXiv:2401.08893
-
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way 1 Dec 2023 · 1 repository · arXiv:2312.00407Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Rethinking SIGN Training: Provable Nonconvex Acceleration without First- and Second-Order Gradient Lipschitz 23 Oct 2023 · 0 repositories · arXiv:2310.14616
-
QFT: Quantized Full-parameter Tuning of LLMs with Affordable Resources 11 Oct 2023 · 0 repositories · arXiv:2310.07147
-
Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts 9 Oct 2023 · 0 repositories · arXiv:2310.05898
-
Handwritten Stenography Recognition and the LION Dataset 15 Aug 2023 · 1 repository · arXiv:2308.07799
-
Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimization 19 Jul 2023 · 0 repositories · arXiv:2307.10053
-
Automatic Trade-off Adaptation in Offline RL 16 Jun 2023 · 0 repositories · arXiv:2306.09744
-
Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks 26 May 2023 · 2 repositories · arXiv:2305.17212Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
LION: Implicit Vision Prompt Tuning 17 Mar 2023 · 0 repositories · arXiv:2303.09992
-
Evolving Deep Neural Network by Customized Moth Flame Optimization Algorithm for Underwater Targets Recognition 16 Feb 2023 · 0 repositories · arXiv:2303.00922
-
Symbolic Discovery of Optimization Algorithms 13 Feb 2023 · 1 repository · arXiv:2302.06675Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Analysis and Prevention of MCAS-Induced Crashes 20 Jan 2023 · 0 repositories · arXiv:2301.08779
Tasks archive 2025-07-28
20 shown of 38 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections