{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/unmask-adversarial-detection-and-defense","title":"UnMask: Adversarial Detection and Defense Through Robust Feature Alignment","arxiv_id":"2002.09576","date":"2020-02-21","proceeding":null,"authors":["Scott Freitas","Shang-Tse Chen","Zijie J. Wang","Duen Horng Chau"],"abstract":"Deep learning models are being integrated into a wide range of high-impact, security-critical systems, from self-driving cars to medical diagnosis. However, recent research has demonstrated that many of these deep learning architectures are vulnerable to adversarial attacks--highlighting the vital need for defensive techniques to detect and mitigate these attacks before they occur. To combat these adversarial attacks, we developed UnMask, an adversarial detection and defense framework based on robust feature alignment. The core idea behind UnMask is to protect these models by verifying that an image's predicted class (\"bird\") contains the expected robust features (e.g., beak, wings, eyes). For example, if an image is classified as \"bird\", but the extracted features are wheel, saddle and frame, the model may be under attack. UnMask detects such attacks and defends the model by rectifying the misclassification, re-classifying the image based on its robust features. Our extensive evaluation shows that UnMask (1) detects up to 96.75% of attacks, and (2) defends the model by correctly classifying up to 93% of adversarial images produced by the current strongest attack, Projected Gradient Descent, in the gray-box setting. UnMask provides significantly better protection than adversarial training across 8 attack vectors, averaging 31.18% higher accuracy. We open source the code repository and data with this paper: https://github.com/safreita1/unmask.","url_abs":"https://arxiv.org/abs/2002.09576v2","url_pdf":"https://arxiv.org/pdf/2002.09576v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unmask-adversarial-detection-and-defense","repo_url":"https://github.com/safreita1/unmask","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"unmask-adversarial-detection-and-defense","repo_url":"https://github.com/Yuxin33/unmask","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"medical-diagnosis","task_name":"Medical Diagnosis"},{"task_slug":"self-driving-cars","task_name":"Self-Driving Cars"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2002.09576","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2002.09576"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Yuxin33/unmask","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/safreita1/unmask","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"ran":3,"unverified":7},"by_repo_kind":{"official":{"samples":12,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d805cf01161ac845","entry":"binary_mask_to_rle","repo":"safreita1/unmask","repo_kind":"official","path":"pycococreatortools/pycococreatortools.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/pycococreatortools/pycococreatortools.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d805cf01161ac845"}},{"code_sha256_prefix":"24680b34da633bbd","entry":"close_contour","repo":"safreita1/unmask","repo_kind":"official","path":"pycococreatortools/pycococreatortools.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/pycococreatortools/pycococreatortools.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24680b34da633bbd"}},{"code_sha256_prefix":"ae91aee49740c295","entry":"compute_backbone_shapes","repo":"safreita1/unmask","repo_kind":"official","path":"Mask_RCNN/mrcnn/model.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/Mask_RCNN/mrcnn/model.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae91aee49740c295"}},{"code_sha256_prefix":"719785e60bebf517","entry":"conv_block","repo":"safreita1/unmask","repo_kind":"official","path":"Mask_RCNN/mrcnn/model.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/Mask_RCNN/mrcnn/model.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"719785e60bebf517"}},{"code_sha256_prefix":"85747a26d672282d","entry":"resize_binary_mask","repo":"safreita1/unmask","repo_kind":"official","path":"pycococreatortools/pycococreatortools.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/pycococreatortools/pycococreatortools.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"85747a26d672282d"}},{"code_sha256_prefix":"1288df8c4540b10d","entry":"color_map","repo":"safreita1/unmask","repo_kind":"official","path":"parts_extraction/VOClabelcolormap.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/parts_extraction/VOClabelcolormap.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1288df8c4540b10d"}},{"code_sha256_prefix":"217810b770db68cd","entry":"get_ax","repo":"safreita1/unmask","repo_kind":"official","path":"extract_features.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/extract_features.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"217810b770db68cd"}},{"code_sha256_prefix":"36e7b417b97a66fb","entry":"get_layer_from_idx","repo":"safreita1/unmask","repo_kind":"official","path":"utils.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"36e7b417b97a66fb"}},{"code_sha256_prefix":"068d3d6699b81f75","entry":"get_layers","repo":"safreita1/unmask","repo_kind":"official","path":"utils.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"068d3d6699b81f75"}},{"code_sha256_prefix":"28c3981539e97ab6","entry":"identity_block","repo":"safreita1/unmask","repo_kind":"official","path":"Mask_RCNN/mrcnn/model.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/Mask_RCNN/mrcnn/model.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"28c3981539e97ab6"}},{"code_sha256_prefix":"e0fb1cfd384c630b","entry":"make_idx_dict","repo":"safreita1/unmask","repo_kind":"official","path":"utils.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0fb1cfd384c630b"}},{"code_sha256_prefix":"d05450b2f519a8c0","entry":"train_valid_split","repo":"safreita1/unmask","repo_kind":"official","path":"models/model_builder.py","file_url":"https://github.com/safreita1/unmask/blob/HEAD/models/model_builder.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d05450b2f519a8c0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}