Methods › General › Regularization › Shake-Shake Regularization
Shake-Shake Regularization
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Shake-Shake Regularization aims to improve the generalization ability of multi-branch networks by replacing the standard summation of parallel branches with a stochastic affine combination. A typical pre-activation ResNet with 2 residual branches would follow this equation:
xᵢ₊₁ = xᵢ + ℱ(xᵢ, 𝒲ᵢ⁽¹⁾) + ℱ(xᵢ, 𝒲ᵢ⁽²⁾)
Shake-shake regularization introduces a random variable αᵢ following a uniform distribution between 0 and 1 during training:
xᵢ₊₁ = xᵢ + αℱ(xᵢ, 𝒲ᵢ⁽¹⁾) + (1-α)ℱ(xᵢ, 𝒲ᵢ⁽²⁾)
Following the same logic as for dropout, all αᵢ are set to the expected value of $0.5$ at test time.
Papers archive 2025-07-28
5 shown of 5, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
CondConv: Conditionally Parameterized Convolutions for Efficient Inference 10 Apr 2019 · 9 repositories · arXiv:1904.04971
-
Data Augmentation using Random Image Cropping and Patching for Deep CNNs 22 Nov 2018 · 1 repository · arXiv:1811.09030
-
Averaging Weights Leads to Wider Optima and Better Generalization 14 Mar 2018 · 17 repositories · arXiv:1803.05407Syntology ran 5 of 9 samples · 4 unverified
-
ShakeDrop regularization 1 Jan 2018 · 0 repositories
-
Shake-Shake regularization 21 May 2017 · 13 repositories · arXiv:1705.07485
Tasks archive 2025-07-28
8 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Image Classification | 2 |
| Data Augmentation | 1 |
| General Classification | 1 |
| Image Augmentation | 1 |
| Image Cropping | 1 |
| Object Detection | 1 |
| Retrieval | 1 |
| Stochastic Optimization | 1 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections