Papers › From SMOTE to Mixup for Deep Imbalanced Classification

From SMOTE to Mixup for Deep Imbalanced Classification

29 Aug 2023arXiv:2308.15457archive 2025-07-28

Wei-Chao Cheng, Tan-Ha Mai, Hsuan-Tien Lin

Given imbalanced data, it is hard to train a good classifier using deep learning because of the poor generalization of minority classes. Traditionally, the well-known synthetic minority oversampling technique (SMOTE) for data augmentation, a data mining approach for imbalanced learning, has been used to improve this generalization. However, it is unclear whether SMOTE also benefits deep learning. In this work, we study why the original SMOTE is insufficient for deep learning, and enhance SMOTE using soft labels. Connecting the resulting soft SMOTE with Mixup, a modern data augmentation technique, leads to a unified framework that puts traditional and modern data augmentation techniques under the same umbrella. A careful study within this framework shows that Mixup improves generalization by implicitly achieving uneven margins between majority and minority classes. We then propose a novel margin-aware Mixup technique that more explicitly achieves uneven margins. Extensive experimental results demonstrate that our proposed technique yields state-of-the-art performance on deep imbalanced classification while achieving superior performance on extremely imbalanced data. The code is open-sourced in our developed package https://github.com/ntucllab/imbalanced-DL to foster future research in this direction.

PaperPDFCode

Code

ntucllab/imbalanced-dl officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ClassificationData AugmentationDeep Learningimbalanced classification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

MixupSMOTE

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections