{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fast-advprop-1","title":"Fast AdvProp","arxiv_id":"2204.09838","date":"2022-04-21","proceeding":"ICLR 2022 4","authors":["Jieru Mei","Yucheng Han","Yutong Bai","Yixiao Zhang","Yingwei Li","Xianhang Li","Alan Yuille","Cihang Xie"],"abstract":"Adversarial Propagation (AdvProp) is an effective way to improve recognition models, leveraging adversarial examples. Nonetheless, AdvProp suffers from the extremely slow training speed, mainly because: a) extra forward and backward passes are required for generating adversarial examples; b) both original samples and their adversarial counterparts are used for training (i.e., 2$\\times$ data). In this paper, we introduce Fast AdvProp, which aggressively revamps AdvProp's costly training components, rendering the method nearly as cheap as the vanilla training. Specifically, our modifications in Fast AdvProp are guided by the hypothesis that disentangled learning with adversarial examples is the key for performance improvements, while other training recipes (e.g., paired clean and adversarial training samples, multi-step adversarial attackers) could be largely simplified. Our empirical results show that, compared to the vanilla training baseline, Fast AdvProp is able to further model performance on a spectrum of visual benchmarks, without incurring extra training cost. Additionally, our ablations find Fast AdvProp scales better if larger models are used, is compatible with existing data augmentation methods (i.e., Mixup and CutMix), and can be easily adapted to other recognition tasks like object detection. The code is available here: https://github.com/meijieru/fast_advprop.","url_abs":"https://arxiv.org/abs/2204.09838v1","url_pdf":"https://arxiv.org/pdf/2204.09838v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fast-advprop-1","repo_url":"https://github.com/meijieru/fast_advprop","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"advprop","method_name":"AdvProp"},{"method_slug":"auxiliary-batch-normalization","method_name":"Auxiliary Batch Normalization"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"mixup","method_name":"Mixup"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2204.09838","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.09838"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/meijieru/fast_advprop","reach":null}],"summary":{"ran_draft_wrong":4},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"84e9f2d94f1a9144","entry":"get_adv_lr_strategy","repo":"meijieru/fast_advprop","repo_kind":"official","path":"fast_advprop.py","file_url":"https://github.com/meijieru/fast_advprop/blob/HEAD/fast_advprop.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"84e9f2d94f1a9144"}},{"code_sha256_prefix":"7cf0359926307898","entry":"get_adv_training_params","repo":"meijieru/fast_advprop","repo_kind":"official","path":"fast_advprop.py","file_url":"https://github.com/meijieru/fast_advprop/blob/HEAD/fast_advprop.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7cf0359926307898"}},{"code_sha256_prefix":"3df87d42e6b4c1cf","entry":"get_module2name","repo":"meijieru/fast_advprop","repo_kind":"official","path":"fast_advprop.py","file_url":"https://github.com/meijieru/fast_advprop/blob/HEAD/fast_advprop.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3df87d42e6b4c1cf"}},{"code_sha256_prefix":"235139a1983bd845","entry":"get_param2name","repo":"meijieru/fast_advprop","repo_kind":"official","path":"fast_advprop.py","file_url":"https://github.com/meijieru/fast_advprop/blob/HEAD/fast_advprop.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"235139a1983bd845"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}