Methods › General › Initialization › Kaiming Initialization
Kaiming Initialization
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Kaiming Initialization, or He Initialization, is an initialization method for neural networks that takes into account the non-linearity of activation functions, such as ReLU activations.
A proper initialization method should avoid reducing or magnifying the magnitudes of input signals exponentially. Using a derivation they work out that the condition to stop this happening is:
1/2nₗVar[wₗ] = 1
This implies an initialization scheme of:
wₗ ∼𝒩(0, 2/nₗ)
That is, a zero-centered Gaussian with standard deviation of √(2/nₗ) (variance shown in equation above). Biases are initialized at 0.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Query Initialization; initialization memory; MAML co-initialization; centroid initialization; Lyapunov initialization; initialization algorithm; Grid-Based Initialization; Flow-Induced Initialization.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 2,931 · with a code link: 1,332 · where Syntology ran a sample: 379 (316 with a run with no instrument failure, 63 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (379 of 2,931 tagged: 316 with a run with no instrument failure, 63 where every run was a failure of Syntology's instrument)
Page 1 of 30: papers 1 to 100 of 2,931, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Circumventing Backdoor Space via Weight Symmetry 9 Jun 2025 · 1 repository · arXiv:2506.07467
-
Synthetic Speech Source Tracing using Metric Learning 3 Jun 2025 · 0 repositories · arXiv:2506.02590
-
OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning 31 May 2025 · 0 repositories · arXiv:2506.00338
-
PointODE: Lightweight Point Cloud Learning with Neural Ordinary Differential Equations on Edge 31 May 2025 · 0 repositories · arXiv:2506.00438
-
ACM-UNet: Adaptive Integration of CNNs and Mamba for Efficient Medical Image Segmentation 30 May 2025 · 0 repositories · arXiv:2505.24481
-
Optimal Weighted Convolution for Classification and Denosing 30 May 2025 · 2 repositories · arXiv:2505.24558
-
Stepsize anything: A unified learning rate schedule for budgeted-iteration training 30 May 2025 · 0 repositories · arXiv:2505.24452
-
Leveraging Diffusion Models for Synthetic Data Augmentation in Protein Subcellular Localization Classification 28 May 2025 · 0 repositories · arXiv:2505.22926
-
Intelligent Incident Hypertension Prediction in Obstructive Sleep Apnea 27 May 2025 · 0 repositories · arXiv:2505.20615
-
Lung Nodule Segmentation: Exploring Data Efficiency and Advanced Architectures 26 May 2025 · 0 repositories
-
Hierarchical-embedding autoencoder with a predictor (HEAP) as efficient architecture for learning long-term evolution of complex multi-scale physical systems 24 May 2025 · 0 repositories · arXiv:2505.18857
-
SW-ViT: A Spatio-Temporal Vision Transformer Network with Post Denoiser for Sequential Multi-Push Ultrasound Shear Wave Elastography 24 May 2025 · 0 repositories · arXiv:2505.18865
-
DECT-based Space-Squeeze Method for Multi-Class Classification of Metastatic Lymph Nodes in Breast Cancer 23 May 2025 · 1 repository · arXiv:2505.17528
-
EVM-Fusion: An Explainable Vision Mamba Architecture with Neural Algorithmic Fusion 23 May 2025 · 0 repositories · arXiv:2505.17367
-
Detailed Evaluation of Modern Machine Learning Approaches for Optic Plastics Sorting 22 May 2025 · 0 repositories · arXiv:2505.16513
-
SuperPure: Efficient Purification of Localized and Distributed Adversarial Patches via Super-Resolution GAN Models 22 May 2025 · 0 repositories · arXiv:2505.16318
-
Analysis of ABC Frontend Audio Systems for the NIST-SRE24 21 May 2025 · 0 repositories · arXiv:2505.15320
-
Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers 21 May 2025 · 0 repositories · arXiv:2505.15239
-
SSPS: Self-Supervised Positive Sampling for Robust Self-Supervised Speaker Verification 20 May 2025 · 1 repository · arXiv:2505.14561
-
Vulnerability of Transfer-Learned Neural Networks to Data Reconstruction Attacks in Small-Data Regime 20 May 2025 · 1 repository · arXiv:2505.14323
-
PhiNet v2: A Mask-Free Brain-Inspired Vision Foundation Model from Video 16 May 2025 · 1 repository · arXiv:2505.11129
-
CheX-DS: Improving Chest X-ray Image Classification with Ensemble Learning Based on DenseNet and Swin Transformer 16 May 2025 · 0 repositories · arXiv:2505.11168
-
A Training Framework for Optimal and Stable Training of Polynomial Neural Networks 16 May 2025 · 1 repository · arXiv:2505.11589
-
The Influence of the Memory Capacity of Neural DDEs on the Universal Approximation Property 12 May 2025 · 0 repositories · arXiv:2505.07244
-
Towards Understanding Deep Learning Model in Image Recognition via Coverage Test 12 May 2025 · 0 repositories · arXiv:2505.08814
-
Reproducing and Improving CheXNet: Deep Learning for Chest X-ray Disease Classification 10 May 2025 · 1 repository · arXiv:2505.06646
-
Achieving 3D Attention via Triplet Squeeze and Excitation Block 9 May 2025 · 0 repositories · arXiv:2505.05943
-
A Benchmark Dataset and a Framework for Urdu Multimodal Named Entity Recognition 8 May 2025 · 0 repositories · arXiv:2505.05148
-
Deep residual learning with product units 7 May 2025 · 0 repositories · arXiv:2505.04397
-
DOTA: Deformable Optimized Transformer Architecture for End-to-End Text Recognition with Retrieval-Augmented Generation 7 May 2025 · 0 repositories · arXiv:2505.04175
-
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer 7 May 2025 · 0 repositories · arXiv:2505.04394
-
ChannelExplorer: Exploring Class Separability Through Activation Channel Visualization 6 May 2025 · 0 repositories · arXiv:2505.04647
-
Not All Parameters Matter: Masking Diffusion Models for Enhancing Generation Ability 6 May 2025 · 1 repository · arXiv:2505.03097
-
Automatic Proficiency Assessment in L2 English Learners 5 May 2025 · 0 repositories · arXiv:2505.02615
-
Sharpness-Aware Minimization with Z-Score Gradient Filtering for Neural Networks 5 May 2025 · 0 repositories · arXiv:2505.02369
-
Retrieval-augmented in-context learning for multimodal large language models in disease classification 4 May 2025 · 0 repositories · arXiv:2505.02087
-
A Neural Architecture Search Method using Auxiliary Evaluation Metric based on ResNet Architecture 2 May 2025 · 0 repositories · arXiv:2505.01313
-
Mjölnir: A Deep Learning Parametrization Framework for Global Lightning Flash Density 28 Apr 2025 · 0 repositories · arXiv:2504.19822
-
TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks 27 Apr 2025 · 1 repository · arXiv:2504.19274
-
Aerial Image Classification in Scarce and Unconstrained Environments via Conformal Prediction 24 Apr 2025 · 0 repositories · arXiv:2504.17655
-
ECGDeDRDNet: A deep learning-based method for Electrocardiogram noise removal using a double recurrent dense network 23 Apr 2025 · 0 repositories · arXiv:2505.05477
-
Representation Learning via Non-Contrastive Mutual Information 23 Apr 2025 · 0 repositories · arXiv:2504.16667
-
Simplified Swarm Learning Framework for Robust and Scalable Diagnostic Services in Cancer Histopathology 23 Apr 2025 · 0 repositories · arXiv:2504.16732
-
A Self-supervised Learning Method for Raman Spectroscopy based on Masked Autoencoders 21 Apr 2025 · 0 repositories · arXiv:2504.16130
-
Med-2D SegNet: A Light Weight Deep Neural Network for Medical 2D Image Segmentation 20 Apr 2025 · 0 repositories · arXiv:2504.14715
-
ResNetVLLM-2: Addressing ResNetVLLM's Multi-Modal Hallucinations 20 Apr 2025 · 0 repositories · arXiv:2504.14429
-
ResNetVLLM -- Multi-modal Vision LLM for the Video Understanding Task 20 Apr 2025 · 0 repositories · arXiv:2504.14432
-
Fairness and Robustness in Machine Unlearning 18 Apr 2025 · 0 repositories · arXiv:2504.13610
-
GLUSE: Enhanced Channel-Wise Adaptive Gated Linear Units SE for Onboard Satellite Earth Observation Image Classification 16 Apr 2025 · 1 repository · arXiv:2504.12484
-
DUE: A Deep Learning Framework and Library for Modeling Unknown Equations 14 Apr 2025 · 1 repository · arXiv:2504.10373
-
Focal Cortical Dysplasia Type II Detection Using Cross Modality Transfer Learning and Grad-CAM in 3D-CNNs for MRI Analysis 10 Apr 2025 · 0 repositories · arXiv:2504.07775
-
Impact of Language Guidance: A Reproducibility Study 10 Apr 2025 · 0 repositories · arXiv:2504.08140
-
Generalized Semantic Contrastive Learning via Embedding Side Information for Few-Shot Object Detection 9 Apr 2025 · 1 repository · arXiv:2504.07060
-
Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing 8 Apr 2025 · 1 repository · arXiv:2504.05657
-
Haphazard Inputs as Images in Online Learning 3 Apr 2025 · 1 repository · arXiv:2504.02912
-
Lightweight Deep Models for Dermatological Disease Detection: A Study on Instance Selection and Channel Optimization 1 Apr 2025 · 0 repositories · arXiv:2504.01208
-
NeuRaLaTeX: A machine learning library written in pure LaTeX 31 Mar 2025 · 0 repositories · arXiv:2503.24187
-
A Multi-Site Study on AI-Driven Pathology Detection and Osteoarthritis Grading from Knee X-Ray 28 Mar 2025 · 0 repositories · arXiv:2503.22176
-
Comparative Analysis of Image, Video, and Audio Classifiers for Automated News Video Segmentation 27 Mar 2025 · 0 repositories · arXiv:2503.21848
-
Deep Learning-Based Hypoglycemia Classification Across Multiple Prediction Horizons 25 Mar 2025 · 0 repositories · arXiv:2504.00009
-
Unsupervised Detection of Fraudulent Transactions in E-commerce Using Contrastive Learning 24 Mar 2025 · 0 repositories · arXiv:2503.18841
-
AI-Based Screening for Depression and Social Anxiety Through Eye Tracking: An Exploratory Study 22 Mar 2025 · 0 repositories · arXiv:2503.17625
-
Automated diagnosis of lung diseases using vision transformer: a comparative study on chest x-ray classification 22 Mar 2025 · 0 repositories · arXiv:2503.18973
-
A Statistical Theory of Contrastive Learning via Approximate Sufficient Statistics 21 Mar 2025 · 0 repositories · arXiv:2503.17538
-
Exploring the Efficacy of Partial Denoising Using Bit Plane Slicing for Enhanced Fracture Identification: A Comparative Study of Deep Learning-Based Approaches and Handcrafted Feature Extraction Techniques 21 Mar 2025 · 0 repositories · arXiv:2503.17030
-
Feature-Based Dual Visual Feature Extraction Model for Compound Multimodal Emotion Recognition 21 Mar 2025 · 1 repository · arXiv:2503.17453
-
Comparative and Interpretative Analysis of CNN and Transformer Models in Predicting Wildfire Spread Using Remote Sensing Data 18 Mar 2025 · 1 repository · arXiv:2503.14150
-
Evaluating Machine Learning Approaches for ASCII Art Generation 18 Mar 2025 · 1 repository · arXiv:2503.14375
-
Online ResNet-Based Adaptive Control for Nonlinear Target Tracking 18 Mar 2025 · 0 repositories · arXiv:2503.14372
-
Improving Medical Waste Classification with Hybrid Capsule Networks 13 Mar 2025 · 0 repositories · arXiv:2503.10426
-
Interactive Multimodal Fusion with Temporal Modeling 13 Mar 2025 · 0 repositories · arXiv:2503.10523
-
Poly-MgNet: Polynomial Building Blocks in Multigrid-Inspired ResNets 13 Mar 2025 · 0 repositories · arXiv:2503.10594
-
Finding the Muses: Identifying Coresets through Loss Trajectories 12 Mar 2025 · 0 repositories · arXiv:2503.09721
-
DeepGrav: Anomalous Gravitational-Wave Detection Through Deep Latent Features 5 Mar 2025 · 1 repository · arXiv:2503.03799
-
Catheter Detection and Segmentation in X-ray Images via Multi-task Learning 4 Mar 2025 · 0 repositories · arXiv:2503.02717
-
EXACT-CT: EXplainable Analysis for Crohn's and Tuberculosis using CT 28 Feb 2025 · 0 repositories · arXiv:2503.00159
-
Segmenting Bi-Atrial Structures Using ResNext Based Framework 28 Feb 2025 · 0 repositories · arXiv:2503.02892
-
Deep Learning-Based Approach for Automatic 2D and 3D MRI Segmentation of Gliomas 27 Feb 2025 · 0 repositories · arXiv:2502.19760
-
Weakly Supervised Pixel-Level Annotation with Visual Interpretability 25 Feb 2025 · 0 repositories · arXiv:2502.17824
-
Automated Flow Pattern Classification in Multi-phase Systems Using AI and Capacitance Sensing Techniques 23 Feb 2025 · 0 repositories · arXiv:2502.16432
-
Category-Selective Neurons in Deep Networks: Comparing Purely Visual and Visual-Language Models 23 Feb 2025 · 0 repositories · arXiv:2502.16456
-
Reducing false positives in strong lens detection through effective augmentation and ensemble learning 20 Feb 2025 · 0 repositories · arXiv:2502.14936
-
Role of the Pretraining and the Adaptation data sizes for low-resource real-time MRI video segmentation 20 Feb 2025 · 0 repositories · arXiv:2502.14418
-
LLM Embeddings for Deep Learning on Tabular Data 17 Feb 2025 · 0 repositories · arXiv:2502.11596
-
Faces of Fairness: Examining Bias in Facial Expression Recognition Datasets and Models 16 Feb 2025 · 0 repositories · arXiv:2502.11049
-
Representation Learning on Out of Distribution in Tabular Data 14 Feb 2025 · 0 repositories · arXiv:2502.10095
-
Automatic Pruning via Structured Lasso with Class-wise Information 13 Feb 2025 · 0 repositories · arXiv:2502.09125
-
SinSim: Sinkhorn-Regularized SimCLR 13 Feb 2025 · 0 repositories · arXiv:2502.10478
-
Multispectral Remote Sensing for Weed Detection in West Australian Agricultural Lands 12 Feb 2025 · 0 repositories · arXiv:2502.08678
-
Dataset Ownership Verification in Contrastive Pre-trained Models 11 Feb 2025 · 1 repository · arXiv:2502.07276
-
Fast-COS: A Fast One-Stage Object Detector Based on Reparameterized Attention Vision Transformer for Autonomous Driving 11 Feb 2025 · 0 repositories · arXiv:2502.07417
-
Unconstrained Body Recognition at Altitude and Range: Comparing Four Approaches 10 Feb 2025 · 0 repositories · arXiv:2502.07130
-
Optimized Unet with Attention Mechanism for Multi-Scale Semantic Segmentation 6 Feb 2025 · 0 repositories · arXiv:2502.03813
-
Boosting Adversarial Robustness and Generalization with Structural Prior 2 Feb 2025 · 0 repositories · arXiv:2502.00834
-
On the inductive bias of infinite-depth ResNets and the bottleneck rank 31 Jan 2025 · 0 repositories · arXiv:2501.19149
-
Self-Supervised Frameworks for Speaker Verification via Bootstrapped Positive Sampling 29 Jan 2025 · 1 repository · arXiv:2501.17772
-
The M-factor: A Novel Metric for Evaluating Neural Architecture Search in Resource-Constrained Environments 29 Jan 2025 · 0 repositories · arXiv:2501.17361
-
The Effect of Optimal Self-Distillation in Noisy Gaussian Mixture Model 27 Jan 2025 · 1 repository · arXiv:2501.16226Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
The Relationship Between Network Similarity and Transferability of Adversarial Attacks 27 Jan 2025 · 0 repositories · arXiv:2501.18629
-
Deep-BrownConrady: Prediction of Camera Calibration and Distortion Parameters Using Deep Learning and Synthetic Data 24 Jan 2025 · 0 repositories · arXiv:2501.14510
Tasks archive 2025-07-28
20 shown of 930 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Image Classification | 453 |
| image-classification | 349 |
| Semantic Segmentation | 285 |
| General Classification | 229 |
| Object Detection | 211 |
| Classification | 203 |
| Segmentation | 193 |
| Transfer Learning | 184 |
| object-detection | 177 |
| Self-Supervised Learning | 159 |
| Contrastive Learning | 148 |
| Representation Learning | 144 |
| Data Augmentation | 128 |
| Deep Learning | 115 |
| Object | 80 |
| Instance Segmentation | 76 |
| GPU | 72 |
| Image Segmentation | 67 |
| Decoder | 65 |
| Diagnostic | 65 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections