{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/carben-composite-adversarial-robustness","title":"CARBEN: Composite Adversarial Robustness Benchmark","arxiv_id":"2207.07797","date":"2022-07-16","proceeding":null,"authors":["Lei Hsiung","Yun-Yun Tsai","Pin-Yu Chen","Tsung-Yi Ho"],"abstract":"Prior literature on adversarial attack methods has mainly focused on attacking with and defending against a single threat model, e.g., perturbations bounded in Lp ball. However, multiple threat models can be combined into composite perturbations. One such approach, composite adversarial attack (CAA), not only expands the perturbable space of the image, but also may be overlooked by current modes of robustness evaluation. This paper demonstrates how CAA's attack order affects the resulting image, and provides real-time inferences of different models, which will facilitate users' configuration of the parameters of the attack level and their rapid evaluation of model prediction. A leaderboard to benchmark adversarial robustness against CAA is also introduced.","url_abs":"https://arxiv.org/abs/2207.07797v1","url_pdf":"https://arxiv.org/pdf/2207.07797v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"carben-composite-adversarial-robustness","repo_url":"https://github.com/IBM/composite-adv","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"adversarial-attack","task_name":"Adversarial Attack"},{"task_slug":"adversarial-robustness","task_name":"Adversarial Robustness"}],"methods":[],"datasets_introduced":[{"slug":"carben","name":"CARBEN","full_name":"Composite Adversarial Robustness Benchmark"}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2207.07797","atlas_url":"https://app.syntology.ai/?focus=2207.07797","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.07797"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/IBM/composite-adv","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":6,"unverified":2},"by_repo_kind":{"official":{"samples":8,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2ff09dbc55d1c1a2","entry":"eval_test","repo":"IBM/composite-adv","repo_kind":"official","path":"train_cifar10.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/train_cifar10.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2ff09dbc55d1c1a2"}},{"code_sha256_prefix":"fffa95de3f8df799","entry":"list_type","repo":"IBM/composite-adv","repo_kind":"official","path":"evaluate_model.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/evaluate_model.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fffa95de3f8df799"}},{"code_sha256_prefix":"796140347cb0999f","entry":"list_type","repo":"IBM/composite-adv","repo_kind":"official","path":"train_imagenet.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/train_imagenet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"796140347cb0999f"}},{"code_sha256_prefix":"a9a4dc0fe0402eef","entry":"make_madry_model","repo":"IBM/composite-adv","repo_kind":"official","path":"composite_adv/utilities.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/composite_adv/utilities.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a9a4dc0fe0402eef"}},{"code_sha256_prefix":"a910d37c1ce20592","entry":"make_model","repo":"IBM/composite-adv","repo_kind":"official","path":"composite_adv/utilities.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/composite_adv/utilities.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a910d37c1ce20592"}},{"code_sha256_prefix":"2417ff185fb94b05","entry":"validate","repo":"IBM/composite-adv","repo_kind":"official","path":"train_imagenet.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/train_imagenet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2417ff185fb94b05"}},{"code_sha256_prefix":"fb0186900a11e115","entry":"make_dataloader","repo":"IBM/composite-adv","repo_kind":"official","path":"composite_adv/utilities.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/composite_adv/utilities.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fb0186900a11e115"}},{"code_sha256_prefix":"0b57f21bdaa164ad","entry":"train_ep","repo":"IBM/composite-adv","repo_kind":"official","path":"train_imagenet.py","file_url":"https://github.com/IBM/composite-adv/blob/HEAD/train_imagenet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0b57f21bdaa164ad"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}