Methods › General › Regularization › DropPath
DropPath
Introduced by Gustav Larsson et al. in FractalNet: Ultra-Deep Neural Networks without Residuals
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Just as dropout prevents co-adaptation of activations, DropPath prevents co-adaptation of parallel paths in networks such as FractalNets by randomly dropping operands of the join layers. This discourages the network from using one input path as an anchor and another as a corrective term (a configuration that, if not prevented, is prone to overfitting). Two sampling strategies are:
- Local: a join drops each input with fixed probability, but we make sure at least one survives.
- Global: a single path is selected for the entire network. We restrict this path to be a single column, thereby promoting individual columns as independently strong predictors.
Papers archive 2025-07-28
22 shown of 22, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Masked Transformer for Electrocardiogram Classification 31 Aug 2023 · 0 repositories · arXiv:2309.07136
-
Lightweight Neural Architecture Search for Temporal Convolutional Networks at the Edge 24 Jan 2023 · 1 repository · arXiv:2301.10281
-
MoBYv2AL: Self-supervised Active Learning for Image Classification 4 Jan 2023 · 1 repository · arXiv:2301.01531
-
NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension 23 Nov 2022 · 1 repository · arXiv:2211.12759
-
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification 23 Oct 2022 · 1 repository · arXiv:2210.12843Syntology ran 0 of 2 samples · 2 unverified
-
AGNAS: Attention-Guided Micro- and Macro-Architecture Search 5 Jun 2022 · 1 repository
-
Search Space Adaptation for Differentiable Neural Architecture Search in Image Classification 5 Jun 2022 · 0 repositories · arXiv:2206.02098
-
Generalizing Few-Shot NAS with Gradient Matching 29 Mar 2022 · 1 repository · arXiv:2203.15207Syntology ran 0 of 7 samples · 7 unverified
-
Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search 23 Feb 2022 · 0 repositories · arXiv:2202.11490
-
Data-Free Neural Architecture Search via Recursive Label Calibration 3 Dec 2021 · 0 repositories · arXiv:2112.02086
-
Profiling Neural Blocks and Design Spaces for Mobile Neural Architecture Search 25 Sep 2021 · 1 repository · arXiv:2109.12426
-
Federated Model Search via Reinforcement Learning 7 Jul 2021 · 0 repositories
-
Generative Adversarial Neural Architecture Search 19 May 2021 · 0 repositories · arXiv:2105.09356
-
Self-Supervised Learning with Swin Transformers 10 May 2021 · 6 repositories · arXiv:2105.04553
-
Generalized Latency Performance Estimation for Once-For-All Neural Architecture Search 4 Jan 2021 · 2 repositories · arXiv:2101.00732
-
Efficient Neural Architecture Search for End-to-end Speech Recognition via Straight-Through Gradients 11 Nov 2020 · 1 repository · arXiv:2011.05649
-
How Does Supernet Help in Neural Architecture Search? 16 Oct 2020 · 0 repositories · arXiv:2010.08219
-
Angle-based Search Space Shrinking for Neural Architecture Search 28 Apr 2020 · 1 repository · arXiv:2004.13431Syntology ran 2 of 4 samples · 2 unverified
-
UNAS: Differentiable Architecture Search Meets Reinforcement Learning 16 Dec 2019 · 1 repository · arXiv:1912.07651
-
Neural Predictor for Neural Architecture Search 2 Dec 2019 · 2 repositories · arXiv:1912.00848Syntology ran 0 of 10 samples · 10 unverified
-
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware 2 Dec 2018 · 23 repositories · arXiv:1812.00332Syntology ran 5 of 27 samples · 22 unverified
-
FractalNet: Ultra-Deep Neural Networks without Residuals 24 May 2016 · 4 repositories · arXiv:1605.07648Syntology ran 4 of 6 samples · 2 unverified · 1 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 34 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections