Methods › General › Initialization › Kaiming Initialization
Kaiming Initialization
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Kaiming Initialization, or He Initialization, is an initialization method for neural networks that takes into account the non-linearity of activation functions, such as ReLU activations.
A proper initialization method should avoid reducing or magnifying the magnitudes of input signals exponentially. Using a derivation they work out that the condition to stop this happening is:
1/2nₗVar[wₗ] = 1
This implies an initialization scheme of:
wₗ ∼𝒩(0, 2/nₗ)
That is, a zero-centered Gaussian with standard deviation of √(2/nₗ) (variance shown in equation above). Biases are initialized at $0$.
Papers archive 2025-07-28
30 shown of 2,931, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Circumventing Backdoor Space via Weight Symmetry 9 Jun 2025 · 1 repository · arXiv:2506.07467
-
Synthetic Speech Source Tracing using Metric Learning 3 Jun 2025 · 0 repositories · arXiv:2506.02590
-
OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning 31 May 2025 · 0 repositories · arXiv:2506.00338
-
PointODE: Lightweight Point Cloud Learning with Neural Ordinary Differential Equations on Edge 31 May 2025 · 0 repositories · arXiv:2506.00438
-
ACM-UNet: Adaptive Integration of CNNs and Mamba for Efficient Medical Image Segmentation 30 May 2025 · 0 repositories · arXiv:2505.24481
-
Optimal Weighted Convolution for Classification and Denosing 30 May 2025 · 2 repositories · arXiv:2505.24558
-
Stepsize anything: A unified learning rate schedule for budgeted-iteration training 30 May 2025 · 0 repositories · arXiv:2505.24452
-
Leveraging Diffusion Models for Synthetic Data Augmentation in Protein Subcellular Localization Classification 28 May 2025 · 0 repositories · arXiv:2505.22926
-
Intelligent Incident Hypertension Prediction in Obstructive Sleep Apnea 27 May 2025 · 0 repositories · arXiv:2505.20615
-
Lung Nodule Segmentation: Exploring Data Efficiency and Advanced Architectures 26 May 2025 · 0 repositories
-
Hierarchical-embedding autoencoder with a predictor (HEAP) as efficient architecture for learning long-term evolution of complex multi-scale physical systems 24 May 2025 · 0 repositories · arXiv:2505.18857
-
SW-ViT: A Spatio-Temporal Vision Transformer Network with Post Denoiser for Sequential Multi-Push Ultrasound Shear Wave Elastography 24 May 2025 · 0 repositories · arXiv:2505.18865
-
DECT-based Space-Squeeze Method for Multi-Class Classification of Metastatic Lymph Nodes in Breast Cancer 23 May 2025 · 1 repository · arXiv:2505.17528
-
EVM-Fusion: An Explainable Vision Mamba Architecture with Neural Algorithmic Fusion 23 May 2025 · 0 repositories · arXiv:2505.17367
-
Detailed Evaluation of Modern Machine Learning Approaches for Optic Plastics Sorting 22 May 2025 · 0 repositories · arXiv:2505.16513
-
SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Models 22 May 2025 · 0 repositories · arXiv:2505.16318
-
Analysis of ABC Frontend Audio Systems for the NIST-SRE24 21 May 2025 · 0 repositories · arXiv:2505.15320
-
Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers 21 May 2025 · 0 repositories · arXiv:2505.15239
-
SSPS: Self-Supervised Positive Sampling for Robust Self-Supervised Speaker Verification 20 May 2025 · 1 repository · arXiv:2505.14561
-
Vulnerability of Transfer-Learned Neural Networks to Data Reconstruction Attacks in Small-Data Regime 20 May 2025 · 1 repository · arXiv:2505.14323
-
PhiNet v2: A Mask-Free Brain-Inspired Vision Foundation Model from Video 16 May 2025 · 1 repository · arXiv:2505.11129
-
CheX-DS: Improving Chest X-ray Image Classification with Ensemble Learning Based on DenseNet and Swin Transformer 16 May 2025 · 0 repositories · arXiv:2505.11168
-
A Training Framework for Optimal and Stable Training of Polynomial Neural Networks 16 May 2025 · 1 repository · arXiv:2505.11589
-
The Influence of the Memory Capacity of Neural DDEs on the Universal Approximation Property 12 May 2025 · 0 repositories · arXiv:2505.07244
-
Towards Understanding Deep Learning Model in Image Recognition via Coverage Test 12 May 2025 · 0 repositories · arXiv:2505.08814
-
Reproducing and Improving CheXNet: Deep Learning for Chest X-ray Disease Classification 10 May 2025 · 1 repository · arXiv:2505.06646
-
Achieving 3D Attention via Triplet Squeeze and Excitation Block 9 May 2025 · 0 repositories · arXiv:2505.05943
-
A Benchmark Dataset and a Framework for Urdu Multimodal Named Entity Recognition 8 May 2025 · 0 repositories · arXiv:2505.05148
-
Deep residual learning with product units 7 May 2025 · 0 repositories · arXiv:2505.04397
-
DOTA: Deformable Optimized Transformer Architecture for End-to-End Text Recognition with Retrieval-Augmented Generation 7 May 2025 · 0 repositories · arXiv:2505.04175
Tasks archive 2025-07-28
20 shown of 930 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Image Classification | 453 |
| image-classification | 349 |
| Semantic Segmentation | 285 |
| General Classification | 229 |
| Object Detection | 211 |
| Classification | 203 |
| Segmentation | 193 |
| Transfer Learning | 184 |
| object-detection | 177 |
| Self-Supervised Learning | 159 |
| Contrastive Learning | 148 |
| Representation Learning | 144 |
| Data Augmentation | 128 |
| Deep Learning | 115 |
| Object | 80 |
| Instance Segmentation | 76 |
| GPU | 72 |
| Image Segmentation | 67 |
| Decoder | 65 |
| Diagnostic | 65 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections