Papers › CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

13 May 2019ICCV 2019 10arXiv:1905.04899archive 2025-07-28

Sangdoo Yun, Dongyoon Han, Seong Joon Oh, Sanghyuk Chun, Junsuk Choe, Youngjoon Yoo

Regional dropout strategies have been proposed to enhance the performance of convolutional neural network classifiers. They have proved to be effective for guiding the model to attend on less discriminative parts of objects (e.g. leg as opposed to head of a person), thereby letting the network generalize better and have better object localization capabilities. On the other hand, current methods for regional dropout remove informative pixels on training images by overlaying a patch of either black pixels or random noise. Such removal is not desirable because it leads to information loss and inefficiency during training. We therefore propose the CutMix augmentation strategy: patches are cut and pasted among training images where the ground truth labels are also mixed proportionally to the area of the patches. By making efficient use of training pixels and retaining the regularization effect of regional dropout, CutMix consistently outperforms the state-of-the-art augmentation strategies on CIFAR and ImageNet classification tasks, as well as on the ImageNet weakly-supervised localization task. Moreover, unlike previous augmentation methods, our CutMix-trained ImageNet classifier, when used as a pretrained model, results in consistent performance gains in Pascal detection and MS-COCO image captioning benchmarks. We also show that CutMix improves the model robustness against input corruptions and its out-of-distribution detection performances. Source code and pretrained models are available at \href{https://github.com/clovaai/CutMix-PyTorch}{https://github.com/clovaai/CutMix-PyTorch}.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1905.04899")

Code

Syntology Ran 17 of 24 code samples harvested from 14 repositories linked to this paper; 7 have no recorded run. Of those that ran: 2 ran · honoured contract; 2 ran · our draft was wrong; 5 ran · fixture could not drive it; 8 ran with no contract checked.

By repository: community (archive-listed): 23 samples from 14 repositories, 17 ran; 1 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

30 repositories listed; official and paper-mentioned ones first.

clovaai/CutMix-PyTorch officialmentioned in papermentioned on GitHubpytorch report
Bennie-Han/Image-augementation-pytorch mentioned on GitHubpytorchnot reachable when probed 2026-09-17 — repositories for recent papers often appear after camera-ready report
IlyaDobrynin/GridMixup mentioned on GitHubpytorch report
PsorTheDoctor/microarray-data mentioned on GitHubtf report
SyogoShibuya/Chainer-Cutmix mentioned on GitHub report
TianshuXie/Cut-Thumbnail mentioned on GitHubpytorch report
Westlake-AI/openmixup mentioned on GitHubpytorch report
airplane2230/keras_cutmix mentioned on GitHubtf report
dongdong69/MixAugmentation mentioned on GitHub report
hh-xiaohu/Image-augementation-pytorch mentioned on GitHubpytorchnot reachable when probed 2026-09-17 — repositories for recent papers often appear after camera-ready report
hysts/pytorch_cutmix mentioned on GitHubpytorch report
ildoonet/cutmix mentioned on GitHubpytorch report
jis478/cutmix_tensorflow2 mentioned on GitHubtf report
js-aguiar/wheat-object-detection mentioned on GitHubpytorch report
juergenlandauer/Maya-Challenge mentioned on GitHubpytorch report
kboseong/RotNet mentioned on GitHubpytorch report
liuch37/image-processing mentioned on GitHubpytorch report
rwightman/pytorch-image-models mentioned on GitHubpytorch report
sangHa0411/ImageNet mentioned on GitHubpytorch report
sangHa0411/VIT mentioned on GitHubpytorch report
xden2331/attentive_cutmix mentioned on GitHubpytorch report
PaddlePaddle/PaddleClas paddleApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

24 samples harvested; 17 ran; 2 honoured the contract we drafted; 7 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · honoured contract
2ran · our draft was wrong
5ran · fixture could not drive it
8ran
7unverified

Licence: 5 of the 24 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 14 repositories linked to this paper, official or community; each sample names its own and says which. Some samples are identical code Syntology first harvested from another repository; for those, this paper's copy is not located and its licence is not recorded. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

BengaliCutMixDataset toshi-k/kaggle-bengaliai-handwritten-grapheme-classification/source/02_nn_solution/debug_dataset.py community (archive-listed) ran Apache-2.0 (permissive) · 692f9c66ea826dc6 · report
BengaliDataset toshi-k/kaggle-bengaliai-handwritten-grapheme-classification/source/02_nn_solution/debug_dataset.py community (archive-listed) ran Apache-2.0 (permissive) · 5c69813c92b3303b · report
CutMix ildoonet/cutmix/cutmix/cutmix.py community (archive-listed) ran MIT (permissive) · 88fd3e4e4d1fa77c · report
CutMix sangHa0411/VIT/cutmix.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · ba67dfd90f9a6f3a · report
CutMixImageDataGenerator DevBruce/CutMixImageDataGenerator_For_Keras/cutmix_keras.py community (archive-listed) ran MIT (permissive) · feb9e03bf1c29e48 · report
Cutmix wangermeng2021/FastClassification/augment/cutmix.py community (archive-listed) ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 30fde01cef8dc1cb · report
GridMixupLoss IlyaDobrynin/GridMixup/gridmix/gridmix_pytorch.py community (archive-listed) ran MIT (permissive) · fe1a906546003ac6 · report
RandomCutMix pytorch/vision/references/classification/transforms.py community (archive-listed) ran · metamorphic tier: deterministic BSD-3-Clause (permissive) · d4b0790e48bdd732 · report
_no_repeat_shuffle_idx Westlake-AI/openmixup/openmixup/models/augments/cutmix.py community (archive-listed) ran · fixture could not drive it Apache-2.0 (permissive) · ccc813c9ad477514 · report
bbox toshi-k/kaggle-bengaliai-handwritten-grapheme-classification/source/02_nn_solution/debug_dataset.py community (archive-listed) ran · honoured contract fingerprinted Apache-2.0 (permissive) · 7e848e7faedb674a · report
crop_resize toshi-k/kaggle-bengaliai-handwritten-grapheme-classification/source/02_nn_solution/debug_dataset.py community (archive-listed) ran · fixture could not drive it fingerprinted Apache-2.0 (permissive) · 7406ca7275b897ae · report
cutmix hysts/pytorch_cutmix/cutmix.py community (archive-listed) ran · our draft was wrong MIT (permissive) · de3489ea88a14549 · report
cutmix Westlake-AI/openmixup/openmixup/models/augments/cutmix.py community (archive-listed) ran · fixture could not drive it Apache-2.0 (permissive) · ed79cd2e87b6c30d · report
cutmix PsorTheDoctor/microarray-data/utils/augmentation.py community (archive-listed) ran · our draft was wrong fingerprinted no licence file found · pointer only · bdf0f6543801b45c · report
get_augmenter toshi-k/kaggle-bengaliai-handwritten-grapheme-classification/source/02_nn_solution/debug_dataset.py community (archive-listed) ran · fixture could not drive it Apache-2.0 (permissive) · 5d040cba7a3612d3 · report
onehot ildoonet/cutmix/cutmix/cutmix.py community (archive-listed) ran · honoured contract MIT (permissive) · a2847ea5f23c1e07 · report
replace_attentive_regions xden2331/attentive_cutmix/attentive_image.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · bc4cc5323c8e7811 · report
CutMixGenerator airplane2230/keras_cutmix/cutmix_generator.py community (archive-listed) unverified no licence file found · pointer only · 793e8454c053efa6 · report
cutmix liuch37/image-processing/augmentation/cutmix_pytorch.py community (archive-listed) unverified Apache-2.0 (permissive) · 8c13b211bd42a04c · report
debug_cutmix toshi-k/kaggle-bengaliai-handwritten-grapheme-classification/source/02_nn_solution/debug_dataset.py community (archive-listed) unverified Apache-2.0 (permissive) · 04e6604fd0b16404 · report
rand_bbox jis478/Tensorflow/TF2.0/Cutmix/Functions.py community (archive-listed) unverified no licence file found · pointer only · c5224b4839efbc28 · report
rand_bbox ildoonet/cutmix/cutmix/cutmix.py community (archive-listed) unverified MIT (permissive) · b3d09a4dd10e16e3 · report
replace_attentive_region xden2331/attentive_cutmix/attentive_image.py community (archive-listed) unverified MIT (permissive) · 49ab4c6f3305f3c0 · report
rand_bbox identical code first harvested elsewhere unverified licence of this copy not recorded · d34a085d71b8f4b5 · report

Tasks

Domain GeneralizationImage CaptioningImage ClassificationObject LocalizationOut-of-Distribution DetectionOut-of-Distribution GeneralizationSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Domain Generalization ImageNet-A CutMix (ResNet-50) Top-1 accuracy % 7.3 #34 of 39 Archive leaderboard report
Image Captioning COCO (Common Objects in Context) NIC (ResNet-50, CutMix) BLEU-1 64.2 #12 of 17 Archive leaderboard report
Image Captioning COCO (Common Objects in Context) NIC (ResNet-50, CutMix) BLEU-2 46.3 #12 of 17 Archive leaderboard report
Image Captioning COCO (Common Objects in Context) NIC (ResNet-50, CutMix) BLEU-3 33.6 #12 of 17 Archive leaderboard report
Image Captioning COCO (Common Objects in Context) NIC (ResNet-50, CutMix) BLEU-4 24.9 #12 of 17 Archive leaderboard report
Image Captioning COCO (Common Objects in Context) NIC (ResNet-50, CutMix) CIDEr 77.6 #12 of 17 Archive leaderboard report
Image Captioning COCO (Common Objects in Context) NIC (ResNet-50, CutMix) METEOR 23.1 #12 of 17 Archive leaderboard report
Image Captioning COCO (Common Objects in Context) NIC (ResNet-50, CutMix) ROUGE 49 #12 of 17 Archive leaderboard report
Image Classification CIFAR-10 PyramidNet-200 + CutMix Percentage correct 97.12 #92 of 265 Archive leaderboard report
Image Classification CIFAR-100 PyramidNet-200 + Shakedrop + Cutmix Percentage correct 86.19 #55 of 211 Archive leaderboard report
Image Classification ImageNet ResNeXt-101 (CutMix) Top 1 Accuracy 80.53% #694 of 1060 Archive leaderboard report
Image Classification ImageNet ResNet-50 (CutMix) Top 1 Accuracy 78.4% #835 of 1060 Archive leaderboard report
Image Classification OmniBenchmark CutMix Average Top-1 Accuracy 31.1 #19 of 22 Archive leaderboard report
Semantic Segmentation ACDC Scribbles CutMix Dice (Average) 70.5% #4 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: CutMix

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConvolutionCutMixDropoutGlobal Average PoolingGrouped ConvolutionKaiming InitializationMax PoolingReLUResNeXtResNeXt BlockResidual BlockResidual ConnectionSGD with MomentumStep Decay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections