Methods › General › Regularization › Stochastic Depth
Stochastic Depth
Introduced by Gao Huang et al. in Deep Networks with Stochastic Depth
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire ResBlocks during training and bypassing their transformations through skip connections.
Let bₗ ∈ {$0, 1$} denote a Bernoulli random variable, which indicates whether the $l$th ResBlock is active (bₗ = 1) or inactive (bₗ = 0). Further, let us denote the “survival” probability of ResBlock l as pₗ = Pr(bₗ = 1). With this definition we can bypass the $l$th ResBlock by multiplying its function fₗ with bₗ and we extend the update rule to:
Hₗ = ReLU(bₗfₗ(Hₗ₋₁) + id(Hₗ₋₁))
If bₗ = 1, this reduces to the original ResNet update and this ResBlock remains unchanged. If bₗ = 0, the ResBlock reduces to the identity function, Hₗ = id((Hₗ−1).
In Syntology repository known, no verified implementation (declared_code; repositories: 5 listed of 15 in the graph, strongest link: official). The lookup matched 'stochastic depth' ignoring case. This answer is about arXiv:1603.09382, the paper the archive credits with this method.
Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.
- stochastic training scheme · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='stochastic training scheme') - unbiased stochastic update · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='unbiased stochastic update') - Stochastic Control Guidance (SCG) · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='Stochastic Control Guidance (SCG)') - stochastic mirror descent framework · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='stochastic mirror descent framework') - decoupling the depth and scope of GNNs · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='decoupling the depth and scope of GNNs') - Stochastic Marginal Actor-Critic (SMAC) · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Stochastic Marginal Actor-Critic (SMAC)')
Origin paper of this answer, arXiv:1603.09382 (its page on this site · its page on Syntology): Syntology's run record for its harvested code, 8 ran (of which 5 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 2 pointer-only (licence). The instrument figure counts failures of Syntology's instrument, not of the code. Ran means executed on a synthesized input, not that the code is correct.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
What each level means, quoted from Syntology's server card: V0 “imports”; V1 “executes against a synthesized fixture and returns a value of the recorded type”; V2 “two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs” “neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)”; V3 “paper-derived property tests pass on both of those same two generations.” The card adds: “No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results.” A level quoted in two parts is one definition the card writes as two clauses joined by a double hyphen, each clause quoted on its own (how these levels are quoted).
Papers archive 2025-07-28
archive papers tagged: 463 · with a code link: 223 · where Syntology ran a sample: 63 (56 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (63 of 463 tagged: 56 with a run with no instrument failure, 7 where every run was a failure of Syntology's instrument)
Page 1 of 5: papers 1 to 100 of 463, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
MD-ViSCo: A Unified Model for Multi-Directional Vital Sign Waveform Conversion 10 Jun 2025 · 1 repository · arXiv:2506.08357
-
MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding 10 Jun 2025 · 0 repositories · arXiv:2506.08356
-
Multi-modal brain MRI synthesis based on SwinUNETR 3 Jun 2025 · 0 repositories · arXiv:2506.02467
-
SST: Self-training with Self-adaptive Thresholding for Semi-supervised Learning 31 May 2025 · 0 repositories · arXiv:2506.00467
-
Deep Modeling and Optimization of Medical Image Classification 29 May 2025 · 1 repository · arXiv:2505.23040
-
ZIPA: A family of efficient models for multilingual phone recognition 29 May 2025 · 1 repository · arXiv:2505.23170Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
AgriFM: A Multi-source Temporal Remote Sensing Foundation Model for Crop Mapping 27 May 2025 · 1 repository · arXiv:2505.21357
-
Structured Initialization for Vision Transformers 26 May 2025 · 0 repositories · arXiv:2505.19985
-
Explainable Anatomy-Guided AI for Prostate MRI: Foundation Models and In Silico Clinical Trials for Virtual Biopsy-based Risk Assessment 23 May 2025 · 0 repositories · arXiv:2505.17971
-
Leveraging Stochastic Depth Training for Adaptive Inference 23 May 2025 · 0 repositories · arXiv:2505.17626
-
Fusion of Foundation and Vision Transformer Model Features for Dermatoscopic Image Classification 22 May 2025 · 0 repositories · arXiv:2505.16338
-
Swin Transformer for Robust CGI Images Detection: Intra- and Inter-Dataset Analysis across Multiple Color Spaces 22 May 2025 · 0 repositories · arXiv:2505.16253
-
Multi-Channel Swin Transformer Framework for Bearing Remaining Useful Life Prediction 20 May 2025 · 0 repositories · arXiv:2505.14897
-
CheX-DS: Improving Chest X-ray Image Classification with Ensemble Learning Based on DenseNet and Swin Transformer 16 May 2025 · 0 repositories · arXiv:2505.11168
-
A Deep Learning-Driven Inhalation Injury Grading Assistant Using Bronchoscopy Images 13 May 2025 · 0 repositories · arXiv:2505.08517
-
Technical Report for ICRA 2025 GOOSE 2D Semantic Segmentation Challenge: Leveraging Color Shift Correction, RoPE-Swin Backbone, and Quantile-based Label Denoising Strategy for Robust Outdoor Scene Understanding 11 May 2025 · 0 repositories · arXiv:2505.06991
-
DFEN: Dual Feature Equalization Network for Medical Image Segmentation 9 May 2025 · 1 repository · arXiv:2505.05913
-
Balancing Accuracy, Calibration, and Efficiency in Active Learning with Vision Transformers Under Label Noise 7 May 2025 · 0 repositories · arXiv:2505.04375
-
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer 7 May 2025 · 0 repositories · arXiv:2505.04394
-
Enhancing DR Classification with Swin Transformer and Shifted Window Attention 20 Apr 2025 · 0 repositories · arXiv:2504.15317
-
SatelliteCalculator: A Multi-Task Vision Foundation Model for Quantitative Remote Sensing Inversion 18 Apr 2025 · 0 repositories · arXiv:2504.13442
-
Towards Accurate and Interpretable Neuroblastoma Diagnosis via Contrastive Multi-scale Pathological Image Analysis 18 Apr 2025 · 1 repository · arXiv:2504.13754
-
Deep Learning-based Bathymetry Retrieval without In-situ Depths using Remote Sensing Imagery and SfM-MVS DSMs with Data Gaps 15 Apr 2025 · 1 repository · arXiv:2504.11416
-
HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation 14 Apr 2025 · 0 repositories · arXiv:2504.09876
-
Foundation Models For Seismic Data Processing: An Extensive Review 31 Mar 2025 · 1 repository · arXiv:2503.24166
-
Camera Model Identification with SPAIR-Swin and Entropy based Non-Homogeneous Patches 28 Mar 2025 · 0 repositories · arXiv:2503.22120
-
Context-Aware Semantic Segmentation: Enhancing Pixel-Level Understanding with Large Language Models for Advanced Vision Applications 25 Mar 2025 · 0 repositories · arXiv:2503.19276
-
iNatAg: Multi-Class Classification Models Enabled by a Large-Scale Benchmark Dataset with 4.7M Images of 2,959 Crop and Weed Species 25 Mar 2025 · 1 repository · arXiv:2503.20068
-
Binarized Mamba-Transformer for Lightweight Quad Bayer HybridEVS Demosaicing 20 Mar 2025 · 1 repository · arXiv:2503.16134
-
Alzheimer's Disease Classification Using Retinal OCT: TransnetOCT and Swin Transformer Models 14 Mar 2025 · 0 repositories · arXiv:2503.11511
-
Finding the Muses: Identifying Coresets through Loss Trajectories 12 Mar 2025 · 0 repositories · arXiv:2503.09721
-
QUIET-SR: Quantum Image Enhancement Transformer for Single Image Super-Resolution 11 Mar 2025 · 0 repositories · arXiv:2503.08759
-
Fish2Mesh Transformer: 3D Human Mesh Recovery from Egocentric Vision 8 Mar 2025 · 0 repositories · arXiv:2503.06089
-
ScaleFusionNet: Transformer-Guided Multi-Scale Feature Fusion for Skin Lesion Segmentation 5 Mar 2025 · 1 repository · arXiv:2503.03327
-
An Efficient Approach to Detecting Lung Nodules Using Swin Transformer 3 Mar 2025 · 0 repositories · arXiv:2503.01592
-
3D Nephrographic Image Synthesis in CT Urography with the Diffusion Model and Swin Transformer 26 Feb 2025 · 0 repositories · arXiv:2502.19623
-
Soybean pod and seed counting in both outdoor fields and indoor laboratories using unions of deep neural networks 21 Feb 2025 · 0 repositories · arXiv:2502.15286
-
A Physics-Informed Deep Learning Model for MRI Brain Motion Correction 13 Feb 2025 · 1 repository · arXiv:2502.09296
-
Swin-MSTP: Swin transformer with multi-scale temporal perception for continuous sign language recognition 7 Feb 2025 · 1 repository
-
Semantic Feature Division Multiple Access for Digital Semantic Broadcast Channels 6 Feb 2025 · 0 repositories · arXiv:2502.03949
-
Exploiting Ensemble Learning for Cross-View Isolated Sign Language Recognition 4 Feb 2025 · 1 repository · arXiv:2502.02196
-
Estimating forest carbon stocks from high-resolution remote sensing imagery by reducing domain shift with style transfer 2 Feb 2025 · 0 repositories · arXiv:2502.00784
-
Milmer: a Framework for Multiple Instance Learning based Multimodal Emotion Recognition 1 Feb 2025 · 1 repository · arXiv:2502.00547
-
Classifying Deepfakes Using Swin Transformers 26 Jan 2025 · 0 repositories · arXiv:2501.15656
-
Vision-Language Models for Automated Chest X-ray Interpretation: Leveraging ViT and GPT-2 21 Jan 2025 · 0 repositories · arXiv:2501.12356
-
Unified Face Matching and Physical-Digital Spoofing Attack Detection 16 Jan 2025 · 0 repositories · arXiv:2501.09635
-
Multi-View Transformers for Airway-To-Lung Ratio Inference on Cardiac CT Scans: The C4R Study 15 Jan 2025 · 0 repositories · arXiv:2501.08902
-
SwinTExCo: Exemplar-based video colorization using Swin Transformer 15 Jan 2025 · 1 repository
-
A Comparative Performance Analysis of Classification and Segmentation Models on Bangladeshi Pothole Dataset 11 Jan 2025 · 0 repositories · arXiv:2501.06602
-
Flash Window Attention: speedup the attention computation for Swin Transformer 11 Jan 2025 · 2 repositories · arXiv:2501.06480
-
Mix-QViT: Mixed-Precision Vision Transformer Quantization Driven by Layer Importance and Quantization Sensitivity 10 Jan 2025 · 0 repositories · arXiv:2501.06357
-
Swin-X2S: Reconstructing 3D Shape from 2D Biplanar X-ray with Swin Transformers 10 Jan 2025 · 0 repositories · arXiv:2501.05961
-
nnY-Net: Swin-NeXt with Cross-Attention for 3D Medical Images Segmentation 2 Jan 2025 · 0 repositories · arXiv:2501.01406
-
A Novel Shape Guided Transformer Network for Instance Segmentation in Remote Sensing Images 31 Dec 2024 · 0 repositories · arXiv:2501.00360
-
A Study on Context Length and Efficient Transformers for Biomedical Image Analysis 31 Dec 2024 · 0 repositories · arXiv:2501.00619
-
SpectralKD: A Unified Framework for Interpreting and Distilling Vision Transformers via Spectral Analysis 26 Dec 2024 · 1 repository · arXiv:2412.19055
-
Distortion-Aware Adversarial Attacks on Bounding Boxes of Object Detectors 25 Dec 2024 · 1 repository · arXiv:2412.18815
-
LayerDropBack: A Universally Applicable Approach for Accelerating Training of Deep Networks 23 Dec 2024 · 1 repository · arXiv:2412.18027
-
Toward Non-Invasive Diagnosis of Bankart Lesions with Deep Learning 9 Dec 2024 · 1 repository · arXiv:2412.06717
-
TransAdapter: Vision Transformer for Feature-Centric Unsupervised Domain Adaptation 5 Dec 2024 · 1 repository · arXiv:2412.04073
-
Global Average Feature Augmentation for Robust Semantic Segmentation with Transformers 2 Dec 2024 · 0 repositories · arXiv:2412.01941
-
Swin Transformer with Enhanced Dropout and Layer-wise Unfreezing for Facial Expression Recognition in Mental Health Detection 2 Dec 2024 · 1 repository
-
MaskRIS: Semantic Distortion-aware Data Augmentation for Referring Image Segmentation 28 Nov 2024 · 1 repository · arXiv:2411.19067
-
HDI-Former: Hybrid Dynamic Interaction ANN-SNN Transformer for Object Detection Using Frames and Events 27 Nov 2024 · 0 repositories · arXiv:2411.18658
-
SatVision-TOA: A Geospatial Foundation Model for Coarse-Resolution All-Sky Remote Sensing Imagery 26 Nov 2024 · 1 repository · arXiv:2411.17000
-
Solaris: A Foundation Model of the Sun 25 Nov 2024 · 0 repositories · arXiv:2411.16339
-
ST-Tree with Interpretability for Multivariate Time Series Classification 18 Nov 2024 · 0 repositories · arXiv:2411.11620
-
NeuReg: Domain-invariant 3D Image Registration on Human and Mouse Brains 9 Nov 2024 · 0 repositories · arXiv:2411.06315
-
Efficient Self-Supervised Barlow Twins from Limited Tissue Slide Cohorts for Colonic Pathology Diagnostics 8 Nov 2024 · 1 repository · arXiv:2411.05959
-
SIRA: Scalable Inter-frame Relation and Association for Radar Perception 4 Nov 2024 · 0 repositories · arXiv:2411.02220
-
Aerial Flood Scene Classification Using Fine-Tuned Attention-based Architecture for Flood-Prone Countries in South Asia 31 Oct 2024 · 0 repositories · arXiv:2411.00169
-
A Framework for Real-Time Volcano-Seismic Event Recognition Based on Multi-Station Seismograms and Semantic Segmentation Models 27 Oct 2024 · 1 repository · arXiv:2410.20595
-
SFB-net for cardiac segmentation: Bridging the semantic gap with attention 24 Oct 2024 · 0 repositories · arXiv:2410.18503
-
FIPER: Generalizable Factorized Features for Robust Low-Level Vision Models 23 Oct 2024 · 0 repositories · arXiv:2410.18083
-
Accelerate Coastal Ocean Circulation Model with AI Surrogate 19 Oct 2024 · 0 repositories · arXiv:2410.14952
-
AttentiveMOS: A Lightweight Attention-Only Model for Speech Quality Prediction 16 Oct 2024 · 0 repositories · arXiv:2410.12675
-
Transformer based super-resolution downscaling for regional reanalysis: Full domain vs tiling approaches 16 Oct 2024 · 0 repositories · arXiv:2410.12728
-
Diabetic retinopathy image classification method based on GreenBen data augmentation 12 Oct 2024 · 0 repositories · arXiv:2410.09444
-
Guided Self-attention: Find the Generalized Necessarily Distinct Vectors for Grain Size Grading 8 Oct 2024 · 0 repositories · arXiv:2410.05762
-
MTFL: Multi-Timescale Feature Learning for Weakly-Supervised Anomaly Detection in Surveillance Videos 8 Oct 2024 · 1 repository · arXiv:2410.05900
-
DiffuseReg: Denoising Diffusion Model for Obtaining Deformation Fields in Unsupervised Deformable Image Registration 7 Oct 2024 · 1 repository · arXiv:2410.05234
-
Masked Autoencoder with Swin Transformer Network for Mitigating Electrode Shift in HD-EMG-based Gesture Recognition 7 Oct 2024 · 0 repositories · arXiv:2410.17261
-
MRF-Net: An Infrared Remote Sensing Image Thin Cloud Removal Method With the Intra-Inter Coherent Constraint 7 Oct 2024 · 1 repository
-
SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Model 3 Oct 2024 · 0 repositories · arXiv:2410.02121
-
RS-FME-SwinT: A Novel Feature Map Enhancement Framework Integrating Customized SwinT with Residual and Spatial CNN for Monkeypox Diagnosis 2 Oct 2024 · 0 repositories · arXiv:2410.01216
-
Advanced Arabic Alphabet Sign Language Recognition Using Transfer Learning and Transformer Models 1 Oct 2024 · 0 repositories · arXiv:2410.00681
-
Domain Aware Multi-Task Pretraining of 3D Swin Transformer for T1-weighted Brain MRI 1 Oct 2024 · 1 repository · arXiv:2410.00410
-
CBAM-SwinT-BL: Small Rail Surface Defect Detection Method Based on Swin Transformer with Block Level CBAM Enhancement 30 Sep 2024 · 0 repositories · arXiv:2409.20113
-
Developing a Dual-Stage Vision Transformer Model for Lung Disease Classification 26 Sep 2024 · 0 repositories · arXiv:2409.18257
-
Going Beyond U-Net: Assessing Vision Transformers for Semantic Segmentation in Microscopy Image Analysis 25 Sep 2024 · 0 repositories · arXiv:2409.16940
-
RoWSFormer: A Robust Watermarking Framework with Swin Transformer for Enhanced Geometric Attack Resilience 23 Sep 2024 · 0 repositories · arXiv:2409.14829
-
Swin-LiteMedSAM: A Lightweight Box-Based Segment Anything Model for Large-Scale Medical Image Datasets 11 Sep 2024 · 1 repository · arXiv:2409.07172Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
A Practical Gated Recurrent Transformer Network Incorporating Multiple Fusions for Video Denoising 10 Sep 2024 · 0 repositories · arXiv:2409.06603
-
AgileIR: Memory-Efficient Group Shifted Windows Attention for Agile Image Restoration 10 Sep 2024 · 0 repositories · arXiv:2409.06206
-
Swin Transformer for Robust Differentiation of Real and Synthetic Images: Intra- and Inter-Dataset Analysis 7 Sep 2024 · 0 repositories · arXiv:2409.04734
-
Assessing UHD Image Quality from Aesthetics, Distortions, and Saliency 1 Sep 2024 · 1 repository · arXiv:2409.00749
-
A Simple Baseline with Single-encoder for Referring Image Segmentation 28 Aug 2024 · 0 repositories · arXiv:2408.15521
-
FastTextSpotter: A High-Efficiency Transformer for Multilingual Scene Text Spotting 27 Aug 2024 · 1 repository · arXiv:2408.14998
-
Satellite Sunroof: High-res Digital Surface Models and Roof Segmentation for Global Solar Mapping 26 Aug 2024 · 0 repositories · arXiv:2408.14400
-
LowCLIP: Adapting the CLIP Model Architecture for Low-Resource Languages in Multimodal Image Retrieval Task 25 Aug 2024 · 0 repositories · arXiv:2408.13909
Tasks archive 2025-07-28
20 shown of 371 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections