Methods › General › Normalization › Spectral Normalization
Spectral Normalization
Introduced by Takeru Miyato et al. in Spectral Normalization for Generative Adversarial Networks
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Spectral Normalization is a normalization technique used for generative adversarial networks, used to stabilize training of the discriminator. Spectral normalization has the convenient property that the Lipschitz constant is the only hyper-parameter to be tuned.
It controls the Lipschitz constant of the discriminator f by constraining the spectral norm of each layer g : hᵢₙ →hₒᵤₜ. The Lipschitz norm ‖g‖_(Lip) is equal to supₕσ(∇g(h)), where σ(a) is the spectral norm of the matrix A (L₂ matrix norm of A):
σ(a) = max_(h:h≠0)(‖Ah‖₂)/(‖h‖₂) = max_(‖h‖₂≤1)‖Ah‖₂
which is equivalent to the largest singular value of A. Therefore for a linear layer g(h) = Wh the norm is given by ‖g‖_(Lip) = supₕσ(∇g(h)) = supₕσ(W) = σ(W). Spectral normalization normalizes the spectral norm of the weight matrix W so it satisfies the Lipschitz constraint σ(W) = 1:
W̅_(SN)(W) = W / σ(W)
In Syntology repository known, no verified implementation (declared_code; repositories: 5 listed of 39 in the graph, strongest link: official). This answer is about arXiv:1802.05957, the paper the archive credits with this method.
Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.
- Spectral DeTuning · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Spectral DeTuning') - Spectral Augmentation · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Spectral Augmentation') - Spectral Contrastive Loss · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Spectral Contrastive Loss') - Spectral Diffusion Processes · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Spectral Diffusion Processes') - spectral initialization method · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='spectral initialization method') - spectral gap optimization framework · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='spectral gap optimization framework')
Origin paper of this answer, arXiv:1802.05957 (its page on this site · its page on Syntology): Syntology's run record for its harvested code, 25 ran (of which 9 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 1 violated, 20 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 31 harvested samples) · 15 pointer-only (licence). The instrument figure counts failures of Syntology's instrument, not of the code. Ran means executed on a synthesized input, not that the code is correct.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
What each level means, quoted from Syntology's server card: V0 “imports”; V1 “executes against a synthesized fixture and returns a value of the recorded type”; V2 “two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs” “neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)”; V3 “paper-derived property tests pass on both of those same two generations.” The card adds: “No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results.” A level quoted in two parts is one definition the card writes as two clauses joined by a double hyphen, each clause quoted on its own (how these levels are quoted).
Papers archive 2025-07-28
archive papers tagged: 220 · with a code link: 115 · where Syntology ran a sample: 36 (30 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (36 of 220 tagged: 30 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)
Page 1 of 3: papers 1 to 100 of 220, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Unpaired Image-to-Image Translation for Segmentation and Signal Unmixing 27 May 2025 · 0 repositories · arXiv:2505.20746
-
Spectral Normalization for Lipschitz-Constrained Policies on Learning Humanoid Locomotion 11 Apr 2025 · 0 repositories · arXiv:2504.08246
-
Probabilistic Skip Connections for Deterministic Uncertainty Quantification in Deep Neural Networks 8 Jan 2025 · 0 repositories · arXiv:2501.04816
-
ParaGAN: A Scalable Distributed Training Framework for Generative Adversarial Networks 6 Nov 2024 · 0 repositories · arXiv:2411.03999
-
Unsupervised Panoptic Interpretation of Latent Spaces in GANs Using Space-Filling Vector Quantization 27 Oct 2024 · 1 repository · arXiv:2410.20573
-
Normalizing self-supervised learning for provably reliable Change Point Detection 17 Oct 2024 · 0 repositories · arXiv:2410.13637
-
XMOL: Explainable Multi-property Optimization of Molecules 12 Sep 2024 · 0 repositories · arXiv:2409.07786
-
Particle physics DL-simulation with control over generated data properties 22 May 2024 · 1 repository · arXiv:2405.14049
-
Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image 21 May 2024 · 1 repository · arXiv:2405.12872
-
On Robust Reinforcement Learning with Lipschitz-Bounded Policy Networks 19 May 2024 · 2 repositories · arXiv:2405.11432
-
Multi-Label Out-of-Distribution Detection with Spectral Normalized Joint Energy 8 May 2024 · 1 repository · arXiv:2405.04759
-
Adaptive Catalyst Discovery Using Multicriteria Bayesian Optimization with Representation Learning 18 Apr 2024 · 1 repository · arXiv:2404.12445
-
Policy Bifurcation in Safe Reinforcement Learning 19 Mar 2024 · 1 repository · arXiv:2403.12847
-
BFRFormer: Transformer-based generator for Real-World Blind Face Restoration 29 Feb 2024 · 0 repositories · arXiv:2402.18811
-
Control-Theoretic Techniques for Online Adaptation of Deep Neural Networks in Dynamical Systems 1 Feb 2024 · 0 repositories · arXiv:2402.00761
-
Convergences for Minimax Optimization Problems over Infinite-Dimensional Spaces Towards Stability in Adversarial Training 2 Dec 2023 · 0 repositories · arXiv:2312.00991
-
On quantifying and improving realism of images generated with diffusion 26 Sep 2023 · 0 repositories · arXiv:2309.14756
-
Model-Based Reparameterization Policy Gradient Methods: Theory and Practical Algorithms 21 Sep 2023 · 1 repository
-
Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flows 21 Sep 2023 · 0 repositories
-
A Strategic Framework for Optimal Decisions in Football 1-vs-1 Shot-Taking Situations: An Integrated Approach of Machine Learning, Theory-Based Modeling, and Game Theory 27 Jul 2023 · 2 repositories · arXiv:2307.14732
-
Pyrus Base: An Open Source Python Framework for the RoboCup 2D Soccer Simulation 22 Jul 2023 · 1 repository · arXiv:2307.16875
-
Diffusion Models Beat GANs on Image Classification 17 Jul 2023 · 1 repository · arXiv:2307.08702
-
A Bayesian approach to quantifying uncertainties and improving generalizability in traffic prediction models 12 Jul 2023 · 0 repositories · arXiv:2307.05946
-
Diversity is Strength: Mastering Football Full Game with Interactive Reinforcement Learning of Multiple AIs 28 Jun 2023 · 0 repositories · arXiv:2306.15903
-
Rosetta Neurons: Mining the Common Units in a Model Zoo 15 Jun 2023 · 0 repositories · arXiv:2306.09346
-
Toward more accurate and generalizable brain deformation estimators for traumatic brain injury detection with unsupervised domain adaptation 8 Jun 2023 · 0 repositories · arXiv:2306.05255
-
FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator 7 Jun 2023 · 0 repositories · arXiv:2306.07936
-
ReLU to the Rescue: Improve Your On-Policy Actor-Critic with Positive Advantages 2 Jun 2023 · 1 repository · arXiv:2306.01460
-
Action valuation of on- and off-ball soccer players based on multi-agent deep reinforcement learning 29 May 2023 · 0 repositories · arXiv:2305.17886
-
Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL? 27 May 2023 · 1 repository · arXiv:2305.17352Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrations 22 May 2023 · 0 repositories · arXiv:2305.13030
-
An Empirical Study on Google Research Football Multi-agent Scenarios 16 May 2023 · 1 repository · arXiv:2305.09458
-
The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation 5 May 2023 · 1 repository · arXiv:2305.03369
-
SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes 11 Apr 2023 · 1 repository · arXiv:2304.05170
-
VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Views 10 Apr 2023 · 1 repository · arXiv:2304.04617
-
Towards Active Learning for Action Spotting in Association Football Videos 9 Apr 2023 · 0 repositories · arXiv:2304.04220
-
Embedding Contextual Information through Reward Shaping in Multi-Agent Learning: A Case Study from Google Football 25 Mar 2023 · 0 repositories · arXiv:2303.15471
-
Deep Generative Multi-Agent Imitation Model as a Computational Benchmark for Evaluating Human Performance in Complex Interactive Tasks: A Case Study in Football 23 Mar 2023 · 0 repositories · arXiv:2303.13323
-
High Fidelity Image Synthesis With Deep VAEs In Latent Space 23 Mar 2023 · 2 repositories · arXiv:2303.13714Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images 13 Mar 2023 · 0 repositories · arXiv:2303.07274
-
Stabilizing Transformer Training by Preventing Attention Entropy Collapse 11 Mar 2023 · 1 repository · arXiv:2303.06296Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
NFL Career Success as Predicted by NFL Scouting Combine 10 Mar 2023 · 1 repository · arXiv:2303.05774
-
Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoning 7 Mar 2023 · 1 repository · arXiv:2303.08046
-
Identification of pattern mining algorithm for rugby league players positional groups separation based on movement patterns 25 Feb 2023 · 0 repositories · arXiv:2302.14058
-
Transformer-Based Neural Marked Spatio Temporal Point Process Model for Football Match Events Analysis 18 Feb 2023 · 1 repository · arXiv:2302.09276
-
TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Play 15 Feb 2023 · 1 repository · arXiv:2302.07515
-
Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observations 13 Feb 2023 · 0 repositories · arXiv:2302.06569
-
Order Matters: Agent-by-agent Policy Optimization 13 Feb 2023 · 1 repository · arXiv:2302.06205Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Impact of velocity and impact angle on football shot accuracy during fundamental trainings 7 Feb 2023 · 0 repositories · arXiv:2302.03426
-
KDEformer: Accelerating Transformers via Kernel Density Estimation 5 Feb 2023 · 1 repository · arXiv:2302.02451Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)
-
Design and Implementation of A Soccer Ball Detection System with Multiple Cameras 31 Jan 2023 · 0 repositories · arXiv:2302.00123
-
Potential Penetrative Pass (P3) 26 Jan 2023 · 0 repositories · arXiv:2302.10760
-
Event Detection in Football using Graph Convolutional Networks 24 Jan 2023 · 0 repositories · arXiv:2301.10052
-
A Machine Learning Approach for Player and Position Adjusted Expected Goals in Football (Soccer) 19 Jan 2023 · 0 repositories · arXiv:2301.13052
-
Sentiment Analysis for Measuring Hope and Fear from Reddit Posts During the 2022 Russo-Ukrainian Conflict 19 Jan 2023 · 0 repositories · arXiv:2301.08347
-
Impact of the Euro 2020 championship on the spread of COVID-19 18 Jan 2023 · 2 repositories · arXiv:2301.07659
-
Exploring Intra-Class Variation Factors With Learnable Cluster Prompts for Semi-Supervised Image Synthesis 1 Jan 2023 · 0 repositories
-
Re-GAN: Data-Efficient GANs Training via Architectural Reconfiguration 1 Jan 2023 · 1 repository
-
Denoising instrumented mouthguard measurements of head impact kinematics with a convolutional neural network 19 Dec 2022 · 0 repositories · arXiv:2212.09832
-
Hierarchical Strategies for Cooperative Multi-Agent Reinforcement Learning 14 Dec 2022 · 0 repositories · arXiv:2212.07397
-
Effects of Spectral Normalization in Multi-agent Reinforcement Learning 10 Dec 2022 · 1 repository · arXiv:2212.05331Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Location analysis of players in UEFA EURO 2020 and 2022 using generalized valuation of defense by estimating probabilities 30 Nov 2022 · 1 repository · arXiv:2212.00021
-
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency 29 Nov 2022 · 1 repository · arXiv:2211.16068Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Predicting Football Match Outcomes with eXplainable Machine Learning and the Kelly Index 28 Nov 2022 · 0 repositories · arXiv:2211.15734
-
Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN 16 Nov 2022 · 0 repositories · arXiv:2211.08742
-
ABCAS: Adaptive Bound Control of spectral norm as Automatic Stabilizer 12 Nov 2022 · 0 repositories · arXiv:2211.06595
-
Gambling on Momentum 11 Nov 2022 · 0 repositories · arXiv:2211.06052
-
Going for GOAL: A Resource for Grounded Football Commentaries 8 Nov 2022 · 1 repository · arXiv:2211.04534
-
Graph-Based Multi-Camera Soccer Player Tracker 3 Nov 2022 · 0 repositories · arXiv:2211.02125
-
Lipschitz-regularized gradient flows and generative particle algorithms for high-dimensional scarce data 31 Oct 2022 · 1 repository · arXiv:2210.17230
-
Teacher-student curriculum learning for reinforcement learning 31 Oct 2022 · 0 repositories · arXiv:2210.17368
-
Recursive Reasoning in Minimax Games: A Level k Gradient Play Method 29 Oct 2022 · 1 repository · arXiv:2210.16482
-
Group Distributionally Robust Reinforcement Learning with Hierarchical Latent Variables 21 Oct 2022 · 0 repositories · arXiv:2210.12262
-
PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning 17 Oct 2022 · 0 repositories · arXiv:2210.08872
-
Betting the system: Using lineups to predict football scores 12 Oct 2022 · 0 repositories · arXiv:2210.06327
-
ELIGN: Expectation Alignment as a Multi-Agent Intrinsic Reward 9 Oct 2022 · 1 repository · arXiv:2210.04365
-
Brain structure can mediate or moderate the relationship of behavior to brain function and transcriptome. A preliminary study 6 Oct 2022 · 0 repositories · arXiv:2210.03195
-
Blind Signal Dereverberation for Machine Speech Recognition 30 Sep 2022 · 0 repositories · arXiv:2210.00117
-
Towards Multimodal Prediction of Spontaneous Humour: A Novel Dataset and First Results 28 Sep 2022 · 2 repositories · arXiv:2209.14272
-
Identifying and Extracting Football Features from Real-World Media Sources using Only Synthetic Training Data 27 Sep 2022 · 0 repositories · arXiv:2209.13254
-
Observation Centric and Central Distance Recovery on Sports Player Tracking 27 Sep 2022 · 1 repository · arXiv:2209.13154
-
Hybrid Multimodal Fusion for Humor Detection 24 Sep 2022 · 0 repositories · arXiv:2209.11949
-
Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Games 21 Sep 2022 · 0 repositories · arXiv:2209.10055
-
Evaluation of 3D GANs for Lung Tissue Modelling in Pulmonary CT 17 Aug 2022 · 1 repository · arXiv:2208.08184
-
SKDCGN: Source-free Knowledge Distillation of Counterfactual Generative Networks using cGANs 8 Aug 2022 · 1 repository · arXiv:2208.04226
-
GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond 29 Jul 2022 · 1 repository · arXiv:2207.14812Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
-
A Variational AutoEncoder for Transformers with Nonparametric Variational Information Bottleneck 27 Jul 2022 · 0 repositories · arXiv:2207.13529
-
BigColor: Colorization using a Generative Color Prior for Natural Images 20 Jul 2022 · 1 repository · arXiv:2207.09685Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis 19 Jun 2022 · 2 repositories · arXiv:2206.09479Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
Improving Human Image Synthesis with Residual Fast Fourier Transformation and Wasserstein Distance 24 May 2022 · 0 repositories · arXiv:2205.12022
-
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness 1 May 2022 · 2 repositories · arXiv:2205.00403Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
OSSGAN: Open-Set Semi-Supervised Image Generation 29 Apr 2022 · 1 repository · arXiv:2204.14249Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Interpreting Class Conditional GANs with Channel Awareness 21 Mar 2022 · 0 repositories · arXiv:2203.11173
-
Alleviating Adversarial Attacks on Variational Autoencoders with MCMC 18 Mar 2022 · 1 repository · arXiv:2203.09940
-
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance 5 Mar 2022 · 0 repositories · arXiv:2203.02770
-
Polarity Sampling: Quality and Diversity Control of Pre-Trained Generative Networks via Singular Values 3 Mar 2022 · 1 repository · arXiv:2203.01993
-
When do GANs replicate? On the choice of dataset size 23 Feb 2022 · 1 repository · arXiv:2202.11765
-
BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations 12 Jan 2022 · 0 repositories · arXiv:2201.04684
-
Think Twice Before Detecting GAN-Generated Fake Images From Their Spectral Domain Imprints 1 Jan 2022 · 0 repositories
-
Positional Encoding Augmented GAN for the Assessment of Wind Flow for Pedestrian Comfort in Urban Areas 15 Dec 2021 · 0 repositories · arXiv:2112.08447
Tasks archive 2025-07-28
20 shown of 201 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections