L2 Regularization

Description from the archive archive 2025-07-28; Papers-with-Code links inside it are rewritten to this site.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 32 papers with code (128 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong Baselines
  30 Oct 2018 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Continual learning has received a great deal of attention recently with several approaches being proposed.
• The Transient Nature of Emergent In-Context Learning in Transformers
  14 Nov 2023 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  The transient nature of ICL is observed in transformers across a range of model sizes and datasets, raising the question of how much to "overtrain" transformers when seeking compact, cheaper-to-run models.
• Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks
  26 May 2023 2 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  This study investigates how weight decay affects the update behavior of individual neurons in deep neural networks through a combination of applied analysis and experimentation.
• DACN: Dual-Attention Convolutional Network for Hyperspectral Image Super-Resolution
  5 Jun 2025 1 repository listed
  2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks.
• WALINET: A water and lipid identification convolutional Neural Network for nuisance signal removal in 1H MR Spectroscopic Imaging
  1 Oct 2024 1 repository listed
  The WALINET (WAter and LIpid neural NETwork) was compared to conventional methods such as the state-of-the-art lipid L2 regularization and Hankel-Lanczos singular value decomposition (HLSVD) water suppression.
• Monkeypox disease recognition model based on improved SE-InceptionV3
  15 Mar 2024 1 repository listed
  In the wake of the global spread of monkeypox, accurate disease recognition has become crucial.
• Convergence of a L2 regularized Policy Gradient Algorithm for the Multi Armed Bandit
  9 Feb 2024 1 repository listed
  Although Multi Armed Bandit (MAB) on one hand and the policy gradient approach on the other hand are among the most used frameworks of Reinforcement Learning, the theoretical properties of the policy gradient algorithm…
• Prevalidated ridge regression is a highly-efficient drop-in replacement for logistic regression for high-dimensional data
  28 Jan 2024 1 repository listed
  Logistic regression is a ubiquitous method for probabilistic classification.
• Gradient-based bilevel optimization for multi-penalty Ridge regression through matrix differential calculus
  23 Nov 2023 1 repository listed
  Common regularization algorithms for linear regression, such as LASSO and Ridge regression, rely on a regularization hyperparameter that balances the tradeoff between minimizing the fitting error and the norm of the…
• Less is More -- Towards parsimonious multi-task models using structured sparsity
  23 Aug 2023 1 repository listed
  In this work, we introduce channel-wise l1/l2 group sparsity in the shared convolutional layers parameters (or weights) of the multi-task learning model.
• Maintaining Plasticity in Deep Continual Learning
  23 Jun 2023 1 repository listed Syntology ran 1 of 5 samples · 4 unverified
  If deep-learning systems are applied in a continual learning setting, then it is well known that they may fail to remember earlier examples.
• It's Enough: Relaxing Diagonal Constraints in Linear Autoencoders for Recommendation
  22 May 2023 1 repository listed
  Inspired by this analysis, we propose simple-yet-effective linear autoencoder models using diagonal inequality constraints, called Relaxed Linear AutoEncoder (RLAE) and Relaxed Denoising Linear AutoEncoder (RDLAE).
• Planting and Mitigating Memorized Content in Predictive-Text Language Models
  16 Dec 2022 1 repository listed
  Language models are widely deployed to provide automatic text completion services in user products.
• Motion Correction and Volumetric Reconstruction for Fetal Functional Magnetic Resonance Imaging Data
  11 Feb 2022 1 repository listed
  Here, we propose a novel framework, which estimates a high-resolution reference volume by using outlier-robust motion correction, and by utilizing Huber L2 regularization for intra-stack volumetric reconstruction of the…
• How Infinitely Wide Neural Networks Can Benefit from Multi-task Learning -- an Exact Macroscopic Characterization
  31 Dec 2021 1 repository listed
  In practice, multi-task learning (through learning features shared among tasks) is an essential property of deep neural networks (NNs).
• Disturbing Target Values for Neural Network Regularization
  11 Oct 2021 1 repository listed
  This active regularization makes use of the model behavior during training to regularize it in a more directed manner.
• Sequence Length is a Domain: Length-based Overfitting in Transformer Models
  15 Sep 2021 1 repository listed
  We demonstrate on a simple string editing task and a machine translation task that the Transformer model performance drops significantly when facing sequences of length diverging from the length distribution in the…
• The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective
  11 Jun 2021 1 repository listed
  Our analysis in this paper decouples capacity and width via the generalization of neural networks to Deep Gaussian Processes (Deep GP), a class of nonparametric hierarchical models that subsume neural nets.
• Learning with Hyperspherical Uniformity
  2 Mar 2021 1 repository listed
  Due to the over-parameterization nature, neural networks are a powerful tool for nonlinear function approximation.
• Towards Unsupervised Deep Image Enhancement with Generative Adversarial Network
  30 Dec 2020 1 repository listed
  In this paper, we present an unsupervised image enhancement generative adversarial network (UEGAN), which learns the corresponding image-to-image mapping from a set of images with desired characteristics in an…
• Neural Pruning via Growing Regularization
  16 Dec 2020 1 repository listed Syntology ran 1 of 3 samples · 2 unverified · 3 pointer-only (licence)
  Regularization has long been utilized to learn sparsity in deep neural network pruning.
• Label-Only Membership Inference Attacks
  28 Jul 2020 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  We empirically show that our label-only membership inference attacks perform on par with prior attacks that required access to model confidences.
• Distributionally Robust Neural Networks
  1 May 2020 1 repository listed
  Distributionally robust optimization (DRO) allows us to learn models that instead minimize the worst-case training loss over a set of pre-defined groups.
• Data and Model Dependencies of Membership Inference Attack
  17 Feb 2020 1 repository listed
  Our results reveal the relationship between MIA accuracy and properties of the dataset and training model in use.
• Understanding and Stabilizing GANs' Training Dynamics with Control Theory
  29 Sep 2019 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  There are existing efforts that model the training dynamics of GANs in the parameter space but the analysis cannot directly motivate practically effective stabilizing methods.
• Learning a smooth kernel regularizer for convolutional neural networks
  5 Mar 2019 1 repository listed
  We propose a smooth kernel regularizer that encourages spatial correlations in convolution kernel weights.
• What is the Effect of Importance Weighting in Deep Learning?
  8 Dec 2018 1 repository listed
  Importance-weighted risk minimization is a key ingredient in many machine learning algorithms for causal inference, domain adaptation, class imbalance, and off-policy reinforcement learning.
• Quantifying Generalization in Reinforcement Learning
  6 Dec 2018 1 repository listed Syntology ran 2 of 3 samples · 1 unverified
  In this paper, we investigate the problem of overfitting in deep reinforcement learning.
• Collaboratively Weighting Deep and Classic Representation via L2 Regularization for Image Classification
  21 Feb 2018 1 repository listed
  We propose a deep collaborative weight-based classification (DeepCWC) method to resolve this problem, by providing a novel option to fully take advantage of deep features in classic machine learning.
• Convolutional Neural Networks for Facial Expression Recognition
  22 Apr 2017 1 repository listed
  We have developed convolutional neural networks (CNN) for a facial expression recognition task.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.