Papers › Enhanced Long-Tailed Recognition with Contrastive CutMix Augmentation

Enhanced Long-Tailed Recognition with Contrastive CutMix Augmentation

6 Jul 2024arXiv:2407.04911archive 2025-07-28

Haolin Pan, Yong Guo, Mianjie Yu, Jian Chen

Real-world data often follows a long-tailed distribution, where a few head classes occupy most of the data and a large number of tail classes only contain very limited samples. In practice, deep models often show poor generalization performance on tail classes due to the imbalanced distribution. To tackle this, data augmentation has become an effective way by synthesizing new samples for tail classes. Among them, one popular way is to use CutMix that explicitly mixups the images of tail classes and the others, while constructing the labels according to the ratio of areas cropped from two images. However, the area-based labels entirely ignore the inherent semantic information of the augmented samples, often leading to misleading training signals. To address this issue, we propose a Contrastive CutMix (ConCutMix) that constructs augmented samples with semantically consistent labels to boost the performance of long-tailed recognition. Specifically, we compute the similarities between samples in the semantic space learned by contrastive learning, and use them to rectify the area-based labels. Experiments show that our ConCutMix significantly improves the accuracy on tail classes as well as the overall performance. For example, based on ResNeXt-50, we improve the overall accuracy on ImageNet-LT by 3.0% thanks to the significant improvement of 3.3% on tail classes. We highlight that the improvement also generalizes well to other benchmarks and models. Our code and pretrained models are available at https://github.com/PanHaulin/ConCutMix.

PaperPDFCode

Code

YuMJie/ConCutMix officialpytorch report
panhaulin/concutmix mentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Contrastive LearningData AugmentationImage ClassificationLong-tail Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Long-tail Learning CIFAR-10-LT (ρ=100) ConCutMix Error Rate 13.93 #9 of 28 Archive leaderboard report
Long-tail Learning CIFAR-10-LT (ρ=50) ConCutMix Error Rate 12.0 #6 of 8 Archive leaderboard report
Long-tail Learning CIFAR-100-LT (ρ=100) ConCutMix Error Rate 46.84 #19 of 66 Archive leaderboard report
Long-tail Learning CIFAR-100-LT (ρ=50) ConCutMix Error Rate 42.6 #14 of 25 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

CutMix

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections