Methods › General › Optimization › Lion

Evolved Sign Momentum

Lion

32 papers tagged archive 2025-07-28

archive 2025-07-28 Description, source and code snippet are the archive's method entry.

Papers archive 2025-07-28

30 shown of 32, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.

• Towards Efficient and Effective Alignment of Large Language Models
  11 Jun 2025 · 0 repositories · arXiv:2506.09329
• Lions and Muons: Optimization via Stochastic Frank-Wolfe
  4 Jun 2025 · 0 repositories · arXiv:2506.04192
• Linear Attention for Efficient Bidirectional Sequence Modeling
  22 Feb 2025 · 1 repository · arXiv:2502.16249
  Syntology ran 14 of 14 samples · 0 unverified · 14 pointer-only (licence)
• AdaGC: Improving Training Stability for Large Language Model Pretraining
  16 Feb 2025 · 0 repositories · arXiv:2502.11034
• Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants
  4 Feb 2025 · 1 repository · arXiv:2502.02431
  Syntology ran 1 of 1 samples · 0 unverified
• How Memory in Optimization Algorithms Implicitly Modifies the Loss
  4 Feb 2025 · 0 repositories · arXiv:2502.02132
• Grams: Gradient Descent with Adaptive Momentum Scaling
  22 Dec 2024 · 1 repository · arXiv:2412.17107
  Syntology ran 1 of 1 samples · 0 unverified
• Lion Cub: Minimizing Communication Overhead in Distributed Lion
  25 Nov 2024 · 0 repositories · arXiv:2411.16462
• MARS: Unleashing the Power of Variance Reduction for Training Large Models
  15 Nov 2024 · 2 repositories · arXiv:2411.10438
  Syntology ran 3 of 5 samples · 2 unverified · 1 pointer-only (licence)
• Convergence Rate Analysis of LION
  12 Nov 2024 · 0 repositories · arXiv:2411.07724
• TalkMosaic: Interactive PhotoMosaic with Multi-modal LLM Q&A Interactions
  20 Sep 2024 · 0 repositories · arXiv:2409.13941
• Learning Spatially-Aware Language and Audio Embeddings
  17 Sep 2024 · 0 repositories · arXiv:2409.11369
• LION: Linear Group RNN for 3D Object Detection in Point Clouds
  25 Jul 2024 · 1 repository · arXiv:2407.18232
  Syntology ran 0 of 7 samples · 7 unverified
• Deconstructing What Makes a Good Optimizer for Language Models
  10 Jul 2024 · 0 repositories · arXiv:2407.07972
• Dynamic Multi-Objective Lion Swarm Optimization with Multi-strategy Fusion: An application in 6R robot trajectory planning
  31 May 2024 · 0 repositories · arXiv:2406.00114
• Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling
  23 May 2024 · 0 repositories · arXiv:2405.14578
• Audio-Visual Speech Recognition based on Regulated Transformer and Spatio-Temporal Fusion Strategy for Driver Assistive Systems
  9 May 2024 · 1 repository
• Communication Efficient Distributed Training with Distributed Lion
  30 Mar 2024 · 0 repositories · arXiv:2404.00438
• FedLion: Faster Adaptive Federated Optimization with Fewer Communication
  15 Feb 2024 · 1 repository · arXiv:2402.09941
  Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
• MADA: Meta-Adaptive Optimizers through hyper-gradient Descent
  17 Jan 2024 · 0 repositories · arXiv:2401.08893
• CoLLiE: Collaborative Training of Large Language Models in an Efficient Way
  1 Dec 2023 · 1 repository · arXiv:2312.00407
  Syntology ran 4 of 7 samples · 3 unverified
• Rethinking SIGN Training: Provable Nonconvex Acceleration without First- and Second-Order Gradient Lipschitz
  23 Oct 2023 · 0 repositories · arXiv:2310.14616
• QFT: Quantized Full-parameter Tuning of LLMs with Affordable Resources
  11 Oct 2023 · 0 repositories · arXiv:2310.07147
• Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts
  9 Oct 2023 · 0 repositories · arXiv:2310.05898
• Handwritten Stenography Recognition and the LION Dataset
  15 Aug 2023 · 1 repository · arXiv:2308.07799
• Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimization
  19 Jul 2023 · 0 repositories · arXiv:2307.10053
• Automatic Trade-off Adaptation in Offline RL
  16 Jun 2023 · 0 repositories · arXiv:2306.09744
• Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks
  26 May 2023 · 2 repositories · arXiv:2305.17212
  Syntology ran 0 of 6 samples · 6 unverified
• LION: Implicit Vision Prompt Tuning
  17 Mar 2023 · 0 repositories · arXiv:2303.09992
• Evolving Deep Neural Network by Customized Moth Flame Optimization Algorithm for Underwater Targets Recognition
  16 Feb 2023 · 0 repositories · arXiv:2303.00922

Tasks archive 2025-07-28

20 shown of 38 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.

Usage over time archive 2025-07-28

Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).

Categories archive 2025-07-28

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections