Methods › General › Parameter Norm Penalties › L1 Regularization
L1 Regularization
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
L₁ Regularization is a regularization technique applied to the weights of a neural network. We minimize a loss function compromising both the primary loss function and a penalty on the L₁ Norm of the weights:
L_(new)(w) = L_(original)(w) + λ||w||₁
where λ is a value determining the strength of the penalty. In contrast to weight decay, L₁ regularization promotes sparsity; i.e. some parameters have an optimal value of zero.
Image Source: Wikipedia
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: l1-APGD; CUDA-L1; L1-Coverage; l1-AutoAttack; FTLE regularization; regularization loss; Path Regularization; cost regularization.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 90 · with a code link: 35 · where Syntology ran a sample: 13 (12 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (13 of 90 tagged: 12 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 90 of 90, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
PRETI: Patient-Aware Retinal Foundation Model via Metadata-Guided Representation Learning 18 May 2025 · 0 repositories · arXiv:2505.12233
-
SPAT: Sensitivity-based Multihead-attention Pruning on Time Series Forecasting Models 13 May 2025 · 0 repositories · arXiv:2505.08768
-
Decoding Futures Price Dynamics: A Regularized Sparse Autoencoder for Interpretable Multi-Horizon Forecasting and Factor Discovery 11 May 2025 · 0 repositories · arXiv:2505.06795
-
High-Frequency Prior-Driven Adaptive Masking for Accelerating Image Super-Resolution 11 May 2025 · 1 repository · arXiv:2505.06975
-
BQSched: A Non-intrusive Scheduler for Batch Concurrent Queries via Reinforcement Learning 27 Apr 2025 · 1 repository · arXiv:2504.19142
-
From Gaze to Insight: Bridging Human Visual Attention and Vision Language Model Explanation for Weakly-Supervised Medical Image Segmentation 15 Apr 2025 · 0 repositories · arXiv:2504.11368
-
NNN: Next-Generation Neural Networks for Marketing Measurement 8 Apr 2025 · 0 repositories · arXiv:2504.06212
-
Remarks on the Polyak-Lojasiewicz inequality and the convergence of gradient systems 31 Mar 2025 · 0 repositories · arXiv:2503.23641
-
Adaptive Rank Allocation: Speeding Up Modern Transformers with RaNA Adapters 23 Mar 2025 · 1 repository · arXiv:2503.18216Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Al-Khwarizmi: Discovering Physical Laws with Foundation Models 3 Feb 2025 · 0 repositories · arXiv:2502.01702
-
Renewable Energy Prediction: A Comparative Study of Deep Learning Models for Complex Dataset Analysis 27 Jan 2025 · 0 repositories · arXiv:2501.15731
-
HAC++: Towards 100X Compression of 3D Gaussian Splatting 21 Jan 2025 · 2 repositories · arXiv:2501.12255
-
Kryptonite-N: Machine Learning Strikes Back 29 Dec 2024 · 0 repositories · arXiv:2412.20588
-
Efficient Masked AutoEncoder for Video Object Counting and A Large-Scale Benchmark 20 Nov 2024 · 0 repositories · arXiv:2411.13056
-
Carbon price fluctuation prediction using blockchain information A new hybrid machine learning approach 5 Nov 2024 · 0 repositories · arXiv:2411.02709
-
EH-MAM: Easy-to-Hard Masked Acoustic Modeling for Self-Supervised Speech Representation Learning 17 Oct 2024 · 1 repository · arXiv:2410.13179Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
Defending Membership Inference Attacks via Privacy-aware Sparsity Tuning 9 Oct 2024 · 0 repositories · arXiv:2410.06814
-
Adaptive Masking Enhances Visual Grounding 4 Oct 2024 · 0 repositories · arXiv:2410.03161
-
Pre-training on High Definition X-ray Images: An Experimental Study 27 Apr 2024 · 1 repository · arXiv:2404.17926
-
Salience-Based Adaptive Masking: Revisiting Token Dynamics for Enhanced Pre-training 12 Apr 2024 · 0 repositories · arXiv:2404.08327
-
Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning 4 Apr 2024 · 2 repositories · arXiv:2404.03323
-
Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning based Recommendation Systems 26 Mar 2024 · 0 repositories · arXiv:2403.17634
-
HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression 21 Mar 2024 · 2 repositories · arXiv:2403.14530
-
Exploiting Adaptive Contextual Masking for Aspect-Based Sentiment Analysis 21 Feb 2024 · 0 repositories · arXiv:2402.13722
-
Manipulating Sparse Double Descent 19 Jan 2024 · 1 repository · arXiv:2401.10686
-
A novel hybrid time-varying graph neural network for traffic flow forecasting 17 Jan 2024 · 0 repositories · arXiv:2401.10155
-
On sparse regression, Lp-regularization, and automated model discovery 9 Oct 2023 · 0 repositories · arXiv:2310.06872
-
Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model 22 Sep 2023 · 0 repositories · arXiv:2309.13018
-
AMLP:Adaptive Masking Lesion Patches for Self-supervised Medical Image Segmentation 8 Sep 2023 · 0 repositories · arXiv:2309.04312
-
SDR-GAIN: A High Real-Time Occluded Pedestrian Pose Completion Method for Autonomous Driving 6 Jun 2023 · 0 repositories · arXiv:2306.03538
-
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model 13 Mar 2023 · 1 repository · arXiv:2303.07457
-
MPS-AMS: Masked Patches Selection and Adaptive Masking Strategy Based Self-Supervised Medical Image Segmentation 27 Feb 2023 · 0 repositories · arXiv:2302.13699
-
Revisiting Pre-training in Audio-Visual Learning 7 Feb 2023 · 1 repository · arXiv:2302.03533
-
HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption 28 Jan 2023 · 0 repositories · arXiv:2301.12063
-
Sparse neural networks with skip-connections for identification of aluminum electrolysis cell 2 Jan 2023 · 0 repositories · arXiv:2301.00582
-
Generalized Deep Learning-based Proximal Gradient Descent for MR Reconstruction 30 Nov 2022 · 0 repositories · arXiv:2211.16881
-
AdaMAE: Adaptive Masking for Efficient Spatiotemporal Learning with Masked Autoencoders 16 Nov 2022 · 2 repositories · arXiv:2211.09120Syntology official (archive's flag): 14 ran · 18 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 25 harvested samples) · 6 pointer-only (licence)
-
Clarinet: A Music Retrieval System 23 Oct 2022 · 1 repository · arXiv:2210.12648
-
Sparse deep neural networks for modeling aluminum electrolysis dynamics 13 Sep 2022 · 0 repositories · arXiv:2209.05832
-
An Efficiency Study for SPLADE Models 8 Jul 2022 · 1 repository · arXiv:2207.03834
-
Unsupervised Representation Learning of Player Behavioral Data with Confidence Guided Masking 25 Apr 2022 · 1 repository
-
Nonlinear VRFT with LASSO 1 Apr 2022 · 0 repositories · arXiv:2204.00590
-
Recursive Least Squares Policy Control with Echo State Network 13 Jan 2022 · 0 repositories · arXiv:2201.04781
-
Probabilistic fine-tuning of pruning masks and PAC-Bayes self-bounded learning 22 Oct 2021 · 0 repositories · arXiv:2110.11804
-
Multi Proxy Anchor Family Loss for Several Types of Gradients 8 Oct 2021 · 0 repositories · arXiv:2110.03997
-
Generative Pre-Training from Molecules 16 Sep 2021 · 1 repository
-
Normalized Augmented Inverse Probability Weighting with Neural Network Predictions 3 Aug 2021 · 0 repositories · arXiv:2108.01768
-
Combining Machine Learning Classifiers for Stock Trading with Effective Feature Extraction 28 Jul 2021 · 1 repository · arXiv:2107.13148
-
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning 4 Jun 2021 · 3 repositories · arXiv:2106.02584Syntology official (archive's flag): 6 ran · 22 ran (of which 4 constructed an object rather than computing a result; 20 with no instrument failure: 2 honoured, 1 violated, 17 with no contract checked; 2 where Syntology's instrument failed) · 8 unverified (of 30 harvested samples)
-
Characterizing the SLOPE Trade-off: A Variational Perspective and the Donoho-Tanner Limit 27 May 2021 · 1 repository · arXiv:2105.13302
-
Building Reliable Explanations of Unreliable Neural Networks: Locally Smoothing Perspective of Model Interpretation 26 Mar 2021 · 1 repository · arXiv:2103.14332Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Channel Scaling: A Scale-and-Select Approach for Transfer Learning 22 Mar 2021 · 0 repositories · arXiv:2103.12228
-
Uncertainty Maximization in Partially Observable Domains: A Cognitive Perspective 22 Feb 2021 · 0 repositories · arXiv:2102.11232
-
Scaling Up Exact Neural Network Compression by ReLU Stability 15 Feb 2021 · 1 repository · arXiv:2102.07804Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Spectrum Attention Mechanism for Time Series Classification 25 Jan 2021 · 0 repositories · arXiv:2101.10420
-
Neuron-level Structured Pruning using Polarization Regularizer 1 Dec 2020 · 1 repository
-
Layer Pruning via Fusible Residual Convolutional Block for Deep Neural Networks 29 Nov 2020 · 0 repositories · arXiv:2011.14356
-
Learning from a Complementary-label Source Domain: Theory and Algorithms 4 Aug 2020 · 1 repository · arXiv:2008.01454Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Clarinet: A One-step Approach Towards Budget-friendly Unsupervised Domain Adaptation 29 Jul 2020 · 1 repository · arXiv:2007.14612Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Graph Neural Networks Including Sparse Interpretability 30 Jun 2020 · 0 repositories · arXiv:2007.00119
-
Deep Double-Side Learning Ensemble Model for Few-Shot Parkinson Speech Recognition 20 Jun 2020 · 0 repositories · arXiv:2006.11593
-
Hybrid Embedded Deep Stacked Sparse Autoencoder with w_LPPD SVM Ensemble 17 Feb 2020 · 0 repositories · arXiv:2002.06761
-
Artificial neural networks for cloud masking of Sentinel-2 ocean images with noise and sunglint 26 Jan 2020 · 1 repository
-
Lossless Compression of Deep Neural Networks 1 Jan 2020 · 0 repositories · arXiv:2001.00218
-
Parallel Neural Text-to-Speech 1 Jan 2020 · 0 repositories
-
Relating lp regularization and reweighted l1 regularization 2 Dec 2019 · 0 repositories · arXiv:1912.00723
-
Improving Transformer Models by Reordering their Sublayers 10 Nov 2019 · 2 repositories · arXiv:1911.03864
-
Identifying Epigenetic Signature of Breast Cancer with Machine Learning 12 Oct 2019 · 0 repositories · arXiv:1910.06899
-
Mish: A Self Regularized Non-Monotonic Activation Function 23 Aug 2019 · 9 repositories · arXiv:1908.08681Syntology official (archive's flag): 6 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
eSports Pro-Players Behavior During the Game Events: Statistical Analysis of Data Obtained Using the Smart Chair 18 Aug 2019 · 1 repository · arXiv:1908.06402
-
SlimYOLOv3: Narrower, Faster and Better for Real-Time UAV Applications 25 Jul 2019 · 2 repositories · arXiv:1907.11093
-
Multi-Speaker End-to-End Speech Synthesis 9 Jul 2019 · 0 repositories · arXiv:1907.04462
-
Augmenting Self-attention with Persistent Memory 2 Jul 2019 · 2 repositories · arXiv:1907.01470Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 4 pointer-only (licence)
-
Predicting epileptic seizures using nonnegative matrix factorization 25 Jun 2019 · 1 repository
-
Non-Autoregressive Neural Text-to-Speech 21 May 2019 · 2 repositories · arXiv:1905.08459Syntology 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Adaptive Attention Span in Transformers 19 May 2019 · 8 repositories · arXiv:1905.07799
-
Neural source-filter waveform models for statistical parametric speech synthesis 27 Apr 2019 · 0 repositories · arXiv:1904.12088
-
Automatic Target Recognition Using Discrimination Based on Optimal Transport 6 Apr 2019 · 0 repositories · arXiv:1904.03534
-
PLIT: An alignment-free computational tool for identification of long non-coding RNAs in plant transcriptomic datasets 12 Feb 2019 · 0 repositories · arXiv:1902.05064
-
ET-Lasso: A New Efficient Tuning of Lasso-type Regularization for High-Dimensional Data 10 Oct 2018 · 0 repositories · arXiv:1810.04513
-
Wasserstein Autoencoders for Collaborative Filtering 15 Sep 2018 · 0 repositories · arXiv:1809.05662
-
ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech 19 Jul 2018 · 5 repositories · arXiv:1807.07281Syntology 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 1 pointer-only (licence)
-
De-Biased Machine Learning of Global and Local Parameters Using Regularized Riesz Representers 23 Feb 2018 · 0 repositories · arXiv:1802.08667
-
Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning 20 Oct 2017 · 7 repositories · arXiv:1710.07654Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
On parameters transformations for emulating sparse priors using variational-Laplace inference 6 Mar 2017 · 0 repositories · arXiv:1703.07168
-
Vote3Deep: Fast Object Detection in 3D Point Clouds Using Efficient Convolutional Neural Networks 21 Sep 2016 · 0 repositories · arXiv:1609.06666
-
Convex Optimization For Non-Convex Problems via Column Generation 14 Feb 2016 · 0 repositories · arXiv:1602.04409
-
Lass-0: sparse non-convex regression by local search 13 Nov 2015 · 0 repositories · arXiv:1511.04402
-
A concave regularization technique for sparse mixture models 1 Dec 2011 · 0 repositories
-
Linear Complementarity for Regularized Policy Evaluation and Improvement 1 Dec 2010 · 0 repositories
Tasks archive 2025-07-28
20 shown of 120 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections