Papers › Expeditious Saliency-guided Mix-up through Random Gradient Thresholding
Expeditious Saliency-guided Mix-up through Random Gradient Thresholding
Minh-Long Luu, Zeyi Huang, Eric P. Xing, Yong Jae Lee, Haohan Wang
Mix-up training approaches have proven to be effective in improving the generalization ability of Deep Neural Networks. Over the years, the research community expands mix-up methods into two directions, with extensive efforts to improve saliency-guided procedures but minimal focus on the arbitrary path, leaving the randomization domain unexplored. In this paper, inspired by the superior qualities of each direction over one another, we introduce a novel method that lies at the junction of the two routes. By combining the best elements of randomness and saliency utilization, our method balances speed, simplicity, and accuracy. We name our method R-Mix following the concept of "Random Mix-up". We demonstrate its effectiveness in generalization, weakly supervised object localization, calibration, and robustness to adversarial attacks. Finally, in order to address the question of whether there exists a better decision protocol, we train a Reinforcement Learning agent that decides the mix-up policies based on the classifier's performance, reducing dependency on human-designed objectives and hyperparameter tuning. Extensive experiments further show that the agent is capable of performing at the cutting-edge level, laying the foundation for a fully automatic mix-up. Our code is released at [https://github.com/minhlong94/Random-Mixup].
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Classifier calibration | CIFAR-100 | R-Mix (PreActResNet-18) | Expected Calibration Error | 3.73 | #1 of 1 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | R-Mix (WideResNet 28-10) | Percentage correct | 85 | #71 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | RL-Mix (WideResNet 28-10) | Percentage correct | 84.9 | #73 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | WideResNet 28-10 + CutMix (OneCycleLR scheduler) | Percentage correct | 83.97 | #81 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | R-Mix (ResNeXt 29-4-24) | Percentage correct | 83.02 | #93 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | RL-Mix (ResNeXt 29-4-24) | Percentage correct | 82.43 | #104 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | R-Mix (WideResNet 16-8) | Percentage correct | 82.32 | #106 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | ResNeXt 29-4-24 + CutMix (OneCycleLR scheduler) | Percentage correct | 82.3 | #107 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | RL-Mix (WideResNet 16-8) | Percentage correct | 82.16 | #109 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | WideResNet 16-8 + CutMix (OneCycleLR scheduler) | Percentage correct | 81.79 | #113 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | R-Mix (PreActResNet-18) | Percentage correct | 81.49 | #119 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | RL-Mix (PreActResNet-18) | Percentage correct | 80.75 | #125 of 211 | Archive leaderboard | report |
| Image Classification | CIFAR-100 | PreActResNet-18 + CutMix (OneCycleLR scheduler) | Percentage correct | 80.6 | #126 of 211 | Archive leaderboard | report |
| Image Classification | ImageNet | R-Mix (ResNet-50) | Top 1 Accuracy | 77.39% | #877 of 1060 | Archive leaderboard | report |
| Weakly-Supervised Object Localization | ImageNet | R-Mix (ResNet-50) | Top-1 Localization Accuracy | 55.58 | #6 of 6 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Introduced by this paper: R-Mix
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections