Papers › Fixing Data Augmentation to Improve Adversarial Robustness

Fixing Data Augmentation to Improve Adversarial Robustness

2 Mar 2021arXiv:2103.01946archive 2025-07-28

Sylvestre-Alvise Rebuffi, Sven Gowal, Dan A. Calian, Florian Stimberg, Olivia Wiles, Timothy Mann

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on both heuristics-driven and data-driven augmentations as a means to reduce robust overfitting. First, we demonstrate that, contrary to previous findings, when combined with model weight averaging, data augmentation can significantly boost robust accuracy. Second, we explore how state-of-the-art generative models can be leveraged to artificially increase the size of the training set and further improve adversarial robustness. Finally, we evaluate our approach on CIFAR-10 against ℓ_∞ and ℓ₂ norm-bounded perturbations of size ϵ= 8/255 and ϵ= 128/255, respectively. We show large absolute improvements of +7.06% and +5.88% in robust accuracy compared to previous state-of-the-art methods. In particular, against ℓ_∞ norm-bounded perturbations of size ϵ= 8/255, our model reaches 64.20% robust accuracy without using any external data, beating most prior works that use external data.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

deepmind/deepmind-research officialmentioned in papertf report
BjoernNieth/LS-Dataset-pruning-in-AT mentioned on GitHubpytorch report
imrahulr/adversarial_robustness_pytorch mentioned on GitHubpytorchMIT report
imrahulr/hat mentioned on GitHubpytorch report
p2333/score mentioned on GitHubpytorch report
wzekai99/dm-improves-at mentioned on GitHubpytorchMIT report
yuyuwu5/ADR mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Adversarial RobustnessData Augmentation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections