Methods › General › Regularization › Off-Diagonal Orthogonal Regularization
Off-Diagonal Orthogonal Regularization
Introduced by Andrew Brock et al. in Large Scale GAN Training for High Fidelity Natural Image Synthesis
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Off-Diagonal Orthogonal Regularization is a modified form of orthogonal regularization originally used in BigGAN. The original orthogonal regularization is known to be limiting so the authors explore several variants designed to relax the constraint while still imparting the desired smoothness to the models. They opt for a modification where they remove diagonal terms from the regularization, and aim to minimize the pairwise cosine similarity between filters but does not constrain their norm:
Rᵦ(W) = β|| WᵀW ⊙(1-I) ||²_F
where 1 denotes a matrix with all elements set to 1. The authors sweep β values and select 10⁻⁴.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Orthogonality Regularization; regularization-sharpness tradeoff; Offline Variance Regularization (OVR); Orthogonal Jacobian Regularization (OroJaR); off-policy log-dispersion regularization (LDR); Orthogonal Decoupling Contrastive Regularization (ODCR); Off-log metric; Off-policy DAE.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 132 · with a code link: 70 · where Syntology ran a sample: 24 (20 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (24 of 132 tagged: 20 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 132, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
ParaGAN: A Scalable Distributed Training Framework for Generative Adversarial Networks 6 Nov 2024 · 0 repositories · arXiv:2411.03999
-
Unsupervised Panoptic Interpretation of Latent Spaces in GANs Using Space-Filling Vector Quantization 27 Oct 2024 · 1 repository · arXiv:2410.20573
-
On quantifying and improving realism of images generated with diffusion 26 Sep 2023 · 0 repositories · arXiv:2309.14756
-
Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flows 21 Sep 2023 · 0 repositories
-
A Strategic Framework for Optimal Decisions in Football 1-vs-1 Shot-Taking Situations: An Integrated Approach of Machine Learning, Theory-Based Modeling, and Game Theory 27 Jul 2023 · 2 repositories · arXiv:2307.14732
-
Pyrus Base: An Open Source Python Framework for the RoboCup 2D Soccer Simulation 22 Jul 2023 · 1 repository · arXiv:2307.16875
-
Diffusion Models Beat GANs on Image Classification 17 Jul 2023 · 1 repository · arXiv:2307.08702
-
Diversity is Strength: Mastering Football Full Game with Interactive Reinforcement Learning of Multiple AIs 28 Jun 2023 · 0 repositories · arXiv:2306.15903
-
Rosetta Neurons: Mining the Common Units in a Model Zoo 15 Jun 2023 · 0 repositories · arXiv:2306.09346
-
Toward more accurate and generalizable brain deformation estimators for traumatic brain injury detection with unsupervised domain adaptation 8 Jun 2023 · 0 repositories · arXiv:2306.05255
-
FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator 7 Jun 2023 · 0 repositories · arXiv:2306.07936
-
Action valuation of on- and off-ball soccer players based on multi-agent deep reinforcement learning 29 May 2023 · 0 repositories · arXiv:2305.17886
-
Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL? 27 May 2023 · 1 repository · arXiv:2305.17352Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrations 22 May 2023 · 0 repositories · arXiv:2305.13030
-
An Empirical Study on Google Research Football Multi-agent Scenarios 16 May 2023 · 1 repository · arXiv:2305.09458
-
The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation 5 May 2023 · 1 repository · arXiv:2305.03369
-
SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes 11 Apr 2023 · 1 repository · arXiv:2304.05170
-
VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Views 10 Apr 2023 · 1 repository · arXiv:2304.04617
-
Towards Active Learning for Action Spotting in Association Football Videos 9 Apr 2023 · 0 repositories · arXiv:2304.04220
-
Embedding Contextual Information through Reward Shaping in Multi-Agent Learning: A Case Study from Google Football 25 Mar 2023 · 0 repositories · arXiv:2303.15471
-
Deep Generative Multi-Agent Imitation Model as a Computational Benchmark for Evaluating Human Performance in Complex Interactive Tasks: A Case Study in Football 23 Mar 2023 · 0 repositories · arXiv:2303.13323
-
High Fidelity Image Synthesis With Deep VAEs In Latent Space 23 Mar 2023 · 2 repositories · arXiv:2303.13714Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images 13 Mar 2023 · 0 repositories · arXiv:2303.07274
-
NFL Career Success as Predicted by NFL Scouting Combine 10 Mar 2023 · 1 repository · arXiv:2303.05774
-
Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoning 7 Mar 2023 · 1 repository · arXiv:2303.08046
-
Identification of pattern mining algorithm for rugby league players positional groups separation based on movement patterns 25 Feb 2023 · 0 repositories · arXiv:2302.14058
-
Transformer-Based Neural Marked Spatio Temporal Point Process Model for Football Match Events Analysis 18 Feb 2023 · 1 repository · arXiv:2302.09276
-
TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Play 15 Feb 2023 · 1 repository · arXiv:2302.07515
-
Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observations 13 Feb 2023 · 0 repositories · arXiv:2302.06569
-
Order Matters: Agent-by-agent Policy Optimization 13 Feb 2023 · 1 repository · arXiv:2302.06205Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Impact of velocity and impact angle on football shot accuracy during fundamental trainings 7 Feb 2023 · 0 repositories · arXiv:2302.03426
-
KDEformer: Accelerating Transformers via Kernel Density Estimation 5 Feb 2023 · 1 repository · arXiv:2302.02451Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)
-
Design and Implementation of A Soccer Ball Detection System with Multiple Cameras 31 Jan 2023 · 0 repositories · arXiv:2302.00123
-
Potential Penetrative Pass (P3) 26 Jan 2023 · 0 repositories · arXiv:2302.10760
-
Event Detection in Football using Graph Convolutional Networks 24 Jan 2023 · 0 repositories · arXiv:2301.10052
-
A Machine Learning Approach for Player and Position Adjusted Expected Goals in Football (Soccer) 19 Jan 2023 · 0 repositories · arXiv:2301.13052
-
Sentiment Analysis for Measuring Hope and Fear from Reddit Posts During the 2022 Russo-Ukrainian Conflict 19 Jan 2023 · 0 repositories · arXiv:2301.08347
-
Impact of the Euro 2020 championship on the spread of COVID-19 18 Jan 2023 · 2 repositories · arXiv:2301.07659
-
Exploring Intra-Class Variation Factors With Learnable Cluster Prompts for Semi-Supervised Image Synthesis 1 Jan 2023 · 0 repositories
-
Denoising instrumented mouthguard measurements of head impact kinematics with a convolutional neural network 19 Dec 2022 · 0 repositories · arXiv:2212.09832
-
Hierarchical Strategies for Cooperative Multi-Agent Reinforcement Learning 14 Dec 2022 · 0 repositories · arXiv:2212.07397
-
Location analysis of players in UEFA EURO 2020 and 2022 using generalized valuation of defense by estimating probabilities 30 Nov 2022 · 1 repository · arXiv:2212.00021
-
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency 29 Nov 2022 · 1 repository · arXiv:2211.16068Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Predicting Football Match Outcomes with eXplainable Machine Learning and the Kelly Index 28 Nov 2022 · 0 repositories · arXiv:2211.15734
-
Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN 16 Nov 2022 · 0 repositories · arXiv:2211.08742
-
Gambling on Momentum 11 Nov 2022 · 0 repositories · arXiv:2211.06052
-
Going for GOAL: A Resource for Grounded Football Commentaries 8 Nov 2022 · 1 repository · arXiv:2211.04534
-
Graph-Based Multi-Camera Soccer Player Tracker 3 Nov 2022 · 0 repositories · arXiv:2211.02125
-
Teacher-student curriculum learning for reinforcement learning 31 Oct 2022 · 0 repositories · arXiv:2210.17368
-
Recursive Reasoning in Minimax Games: A Level k Gradient Play Method 29 Oct 2022 · 1 repository · arXiv:2210.16482
-
Group Distributionally Robust Reinforcement Learning with Hierarchical Latent Variables 21 Oct 2022 · 0 repositories · arXiv:2210.12262
-
PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning 17 Oct 2022 · 0 repositories · arXiv:2210.08872
-
Betting the system: Using lineups to predict football scores 12 Oct 2022 · 0 repositories · arXiv:2210.06327
-
ELIGN: Expectation Alignment as a Multi-Agent Intrinsic Reward 9 Oct 2022 · 1 repository · arXiv:2210.04365
-
Brain structure can mediate or moderate the relationship of behavior to brain function and transcriptome. A preliminary study 6 Oct 2022 · 0 repositories · arXiv:2210.03195
-
Towards Multimodal Prediction of Spontaneous Humour: A Novel Dataset and First Results 28 Sep 2022 · 2 repositories · arXiv:2209.14272
-
Identifying and Extracting Football Features from Real-World Media Sources using Only Synthetic Training Data 27 Sep 2022 · 0 repositories · arXiv:2209.13254
-
Observation Centric and Central Distance Recovery on Sports Player Tracking 27 Sep 2022 · 1 repository · arXiv:2209.13154
-
Hybrid Multimodal Fusion for Humor Detection 24 Sep 2022 · 0 repositories · arXiv:2209.11949
-
Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Games 21 Sep 2022 · 0 repositories · arXiv:2209.10055
-
Evaluation of 3D GANs for Lung Tissue Modelling in Pulmonary CT 17 Aug 2022 · 1 repository · arXiv:2208.08184
-
SKDCGN: Source-free Knowledge Distillation of Counterfactual Generative Networks using cGANs 8 Aug 2022 · 1 repository · arXiv:2208.04226
-
GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond 29 Jul 2022 · 1 repository · arXiv:2207.14812Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
-
BigColor: Colorization using a Generative Color Prior for Natural Images 20 Jul 2022 · 1 repository · arXiv:2207.09685Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis 19 Jun 2022 · 2 repositories · arXiv:2206.09479Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
OSSGAN: Open-Set Semi-Supervised Image Generation 29 Apr 2022 · 1 repository · arXiv:2204.14249Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Interpreting Class Conditional GANs with Channel Awareness 21 Mar 2022 · 0 repositories · arXiv:2203.11173
-
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance 5 Mar 2022 · 0 repositories · arXiv:2203.02770
-
Polarity Sampling: Quality and Diversity Control of Pre-Trained Generative Networks via Singular Values 3 Mar 2022 · 1 repository · arXiv:2203.01993
-
When do GANs replicate? On the choice of dataset size 23 Feb 2022 · 1 repository · arXiv:2202.11765
-
BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations 12 Jan 2022 · 0 repositories · arXiv:2201.04684
-
Think Twice Before Detecting GAN-Generated Fake Images From Their Spectral Domain Imprints 1 Jan 2022 · 0 repositories
-
DGL-GAN: Discriminator Guided Learning for GAN Compression 13 Dec 2021 · 1 repository · arXiv:2112.06502
-
Scatterbrain: Unifying Sparse and Low-rank Attention Approximation 28 Oct 2021 · 1 repository · arXiv:2110.15343Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Sparse Unbalanced GAN Training with In-Time Over-Parameterization 29 Sep 2021 · 0 repositories
-
Aesthetics and neural network image representations 16 Sep 2021 · 0 repositories · arXiv:2109.08103
-
Instance-Conditioned GAN 10 Sep 2021 · 1 repository · arXiv:2109.05070
-
Improving generative adversarial network inversion via fine-tuning GAN encoders 23 Aug 2021 · 4 repositories · arXiv:2108.10201
-
Sinogram Denoise Based on Generative Adversarial Networks 9 Aug 2021 · 0 repositories · arXiv:2108.03903
-
Unrealistic Feature Suppression for Generative Adversarial Networks 23 Jul 2021 · 0 repositories · arXiv:2107.11047
-
Direct Reconstruction of Linear Parametric Images from Dynamic PET Using Nonlocal Deep Image Prior 18 Jun 2021 · 0 repositories · arXiv:2106.10359
-
Cascaded Diffusion Models for High Fidelity Image Generation 30 May 2021 · 0 repositories · arXiv:2106.15282
-
Scatterbrain: Unifying Sparse and Low-rank Attention 21 May 2021 · 1 repository
-
Efficient Subsampling of Realistic Images From GANs Conditional on a Class or a Continuous Variable 20 Mar 2021 · 1 repository · arXiv:2103.11166
-
Understanding Invariance via Feedforward Inversion of Discriminatively Trained Classifiers 15 Mar 2021 · 0 repositories · arXiv:2103.07470
-
Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective 28 Feb 2021 · 1 repository · arXiv:2103.00397
-
Complex Momentum for Optimization in Games 16 Feb 2021 · 0 repositories · arXiv:2102.08431
-
Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search 2 Feb 2021 · 3 repositories · arXiv:2102.01645
-
GAN Inversion: A Survey 14 Jan 2021 · 1 repository · arXiv:2101.05278
-
A Geometric Analysis of Deep Generative Image Models and Its Applications 1 Jan 2021 · 1 repository
-
Naturalistic Physical Adversarial Patch for Object Detectors 1 Jan 2021 · 1 repository
-
not-so-big-GAN: Generating High-Fidelity Images on Small Compute with Wavelet-based Super-Resolution 1 Jan 2021 · 0 repositories
-
Adaptive Weighted Discriminator for Training Generative Adversarial Networks 5 Dec 2020 · 3 repositories · arXiv:2012.03149
-
SMYRF - Efficient Attention using Asymmetric Clustering 1 Dec 2020 · 1 repository
-
Omni-GAN: On the Secrets of cGANs and Beyond 26 Nov 2020 · 3 repositories · arXiv:2011.13074
-
DeepI2I: Enabling Deep Hierarchical Image-to-Image Translation by Transferring from GANs 11 Nov 2020 · 1 repository · arXiv:2011.05867
-
Conditioning Trick for Training Stable GANs 12 Oct 2020 · 0 repositories · arXiv:2010.05844
-
SMYRF: Efficient Attention using Asymmetric Clustering 11 Oct 2020 · 1 repository · arXiv:2010.05315Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
LOGAN: Local Group Bias Detection by Clustering 6 Oct 2020 · 1 repository · arXiv:2010.02867
-
TinyGAN: Distilling BigGAN for Conditional Image Generation 29 Sep 2020 · 1 repository · arXiv:2009.13829
Tasks archive 2025-07-28
20 shown of 141 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections