Methods › General › Normalization › Gradient Normalization
Gradient Normalization
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Gradient Normalization is a normalization method for Generative Adversarial Networks to tackle the training instability of generative adversarial networks caused by the sharp gradient space. Unlike existing work such as gradient penalty and spectral normalization, the proposed GN only imposes a hard 1-Lipschitz constraint on the discriminator function, which increases the capacity of the network.
Papers archive 2025-07-28
15 shown of 15, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
AlphaGrad: Non-Linear Gradient Normalization Optimizer 22 Apr 2025 · 0 repositories · arXiv:2504.16020
-
Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam 24 Feb 2025 · 1 repository · arXiv:2502.17055
-
Network scaling and scale-driven loss balancing for intelligent poroelastography 27 Oct 2024 · 0 repositories · arXiv:2411.08886
-
Gradient Normalization Provably Benefits Nonconvex SGD under Heavy-Tailed Noise 21 Oct 2024 · 0 repositories · arXiv:2410.16561
-
Adaptive Gradient Normalization and Independent Sampling for (Stochastic) Generalized-Smooth Optimization 17 Oct 2024 · 0 repositories · arXiv:2410.14054
-
Training on Fake Labels: Mitigating Label Leakage in Split Learning via Secure Dimension Transformation 11 Oct 2024 · 0 repositories · arXiv:2410.09125
-
Adaptive Gradient Regularization: A Faster and Generalizable Optimization Technique for Deep Neural Networks 24 Jul 2024 · 0 repositories · arXiv:2407.16944
-
OFVL-MS: Once for Visual Localization across Multiple Indoor Scenes 23 Aug 2023 · 1 repository · arXiv:2308.11928Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
-
Continual Domain Adaptation on Aerial Images under Gradually Degrading Weather 2 Aug 2023 · 1 repository · arXiv:2308.00924
-
Penalty Gradient Normalization for Generative Adversarial Networks 23 Jun 2023 · 1 repository · arXiv:2306.13576
-
Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima 16 Jun 2023 · 0 repositories · arXiv:2306.09850
-
A Deep Learning Approach Using Masked Image Modeling for Reconstruction of Undersampled K-spaces 24 Aug 2022 · 1 repository · arXiv:2208.11472
-
GraN-GAN: Piecewise Gradient Normalization for Generative Adversarial Networks 4 Nov 2021 · 0 repositories · arXiv:2111.03162
-
Perturbated Gradients Updating within Unit Space for Deep Learning 1 Oct 2021 · 1 repository · arXiv:2110.00199
-
Gradient Normalization for Generative Adversarial Networks 6 Sep 2021 · 1 repository · arXiv:2109.02235
Tasks archive 2025-07-28
14 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections