{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2508-00649","title":"Revisiting Adversarial Patch Defenses on Object Detectors: Unified Evaluation, Large-Scale Dataset, and New Insights","arxiv_id":"2508.00649","date":"2025-08-01","proceeding":"ICCV","authors":["Junhao Zheng","Jiahao Sun","Chenhao Lin","Zhengyu Zhao","Chen Ma","Chong Zhang","Cong Wang","Qian Wang","Chao Shen"],"abstract":"Developing reliable defenses against patch attacks on object detectors has attracted increasing interest. However, we identify that existing defense evaluations lack a unified and comprehensive framework, resulting in inconsistent and incomplete assessments of current methods. To address this issue, we revisit 11 representative defenses and present the first patch defense benchmark, involving 2 attack goals, 13 patch attacks, 11 object detectors, and 4 diverse metrics. This leads to the large-scale adversarial patch dataset with 94 types of patches and 94,000 images. Our comprehensive analyses reveal new insights: (1) The difficulty in defending against naturalistic patches lies in the data distribution, rather than the commonly believed high frequencies. Our new dataset with diverse patch distributions can be used to improve existing defenses by 15.09% AP@0.5. (2) The average precision of the attacked object, rather than the commonly pursued patch detection accuracy, shows high consistency with defense performance. (3) Adaptive attacks can substantially bypass existing defenses, and defenses with complex/stochastic models or universal patch properties are relatively robust. We hope that our analyses will serve as guidance on properly evaluating patch attacks/defenses and advancing their design. Code and dataset are available at https://github.com/Gandolfczjh/APDE, where we will keep integrating new attacks/defenses.","url_abs":"https://arxiv.org/abs/2508.00649","url_pdf":"https://arxiv.org/pdf/2508.00649","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2508.00649","atlas_url":"https://app.syntology.ai/?focus=2508.00649","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2508.00649"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Gandolfczjh/APDE","reach":{"status":"ok"}}],"summary":{"ran_honours":1,"unverified":7},"by_repo_kind":{"found_in_text":{"samples":8,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"86db6b7ab1646a7c","entry":"autopad","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"defense/NAPGuard/models/common.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/defense/NAPGuard/models/common.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"86db6b7ab1646a7c"}},{"code_sha256_prefix":"532ec84883eb90ab","entry":"dice_coeff","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"defense/SegmentAndComplete/dice_loss.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/defense/SegmentAndComplete/dice_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"532ec84883eb90ab"}},{"code_sha256_prefix":"2c7d8c046cfd2097","entry":"feature_shield","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"defense/NAPGuard/val_NAPGuard.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/defense/NAPGuard/val_NAPGuard.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2c7d8c046cfd2097"}},{"code_sha256_prefix":"b661522c920e49fb","entry":"parse_labels","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"apde_data/dataset.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/apde_data/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b661522c920e49fb"}},{"code_sha256_prefix":"0a217b21ea93d8c9","entry":"precision","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"defense/SegmentAndComplete/dice_loss.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/defense/SegmentAndComplete/dice_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0a217b21ea93d8c9"}},{"code_sha256_prefix":"ea148596b9de2135","entry":"recall","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"defense/SegmentAndComplete/dice_loss.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/defense/SegmentAndComplete/dice_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ea148596b9de2135"}},{"code_sha256_prefix":"84a52cb49a40917d","entry":"resolve_file","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"apde_data/dataset.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/apde_data/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"84a52cb49a40917d"}},{"code_sha256_prefix":"386a04c4b6c96c88","entry":"smooth_BCE","repo":"Gandolfczjh/APDE","repo_kind":"found_in_text","path":"defense/NAPGuard/utils/loss.py","file_url":"https://github.com/Gandolfczjh/APDE/blob/HEAD/defense/NAPGuard/utils/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"386a04c4b6c96c88"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_api"},"syntology_extracted_results":null}