{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/can-protective-perturbation-safeguard","title":"Can Protective Perturbation Safeguard Personal Data from Being Exploited by Stable Diffusion?","arxiv_id":"2312.00084","date":"2023-11-30","proceeding":"CVPR 2024 1","authors":["Zhengyue Zhao","Jinhao Duan","Kaidi Xu","Chenan Wang","Rui Zhang","Zidong Du","Qi Guo","Xing Hu"],"abstract":"Stable Diffusion has established itself as a foundation model in generative AI artistic applications, receiving widespread research and application. Some recent fine-tuning methods have made it feasible for individuals to implant personalized concepts onto the basic Stable Diffusion model with minimal computational costs on small datasets. However, these innovations have also given rise to issues like facial privacy forgery and artistic copyright infringement. In recent studies, researchers have explored the addition of imperceptible adversarial perturbations to images to prevent potential unauthorized exploitation and infringements when personal data is used for fine-tuning Stable Diffusion. Although these studies have demonstrated the ability to protect images, it is essential to consider that these methods may not be entirely applicable in real-world scenarios. In this paper, we systematically evaluate the use of perturbations to protect images within a practical threat model. The results suggest that these approaches may not be sufficient to safeguard image privacy and copyright effectively. Furthermore, we introduce a purification method capable of removing protected perturbations while preserving the original image structure to the greatest extent possible. Experiments reveal that Stable Diffusion can effectively learn from purified images over all protective methods.","url_abs":"https://arxiv.org/abs/2312.00084v2","url_pdf":"https://arxiv.org/pdf/2312.00084v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"can-protective-perturbation-safeguard","repo_url":"https://github.com/zhengyuezhao/gridpure","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2312.00084","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.00084"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhengyuezhao/gridpure","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":5,"ran_honours":3,"ran":4,"unverified":6},"by_repo_kind":{"official":{"samples":18,"ran":12,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8ab9a97df8161f31","entry":"center_crop_arr","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/image_datasets.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/image_datasets.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":2,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8ab9a97df8161f31"}},{"code_sha256_prefix":"cfd76fd0d89574a4","entry":"approx_standard_normal_cdf","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/losses.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cfd76fd0d89574a4"}},{"code_sha256_prefix":"2ab2316ac6fdd869","entry":"betas_for_alpha_bar","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/gaussian_diffusion.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/gaussian_diffusion.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ab2316ac6fdd869"}},{"code_sha256_prefix":"256040ccde7473f2","entry":"collate_fn","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"train_text_to_image_lora.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/train_text_to_image_lora.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"256040ccde7473f2"}},{"code_sha256_prefix":"abb46f51790a26a8","entry":"collate_fn","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"poison_adv.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/poison_adv.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"abb46f51790a26a8"}},{"code_sha256_prefix":"cd33283d615fb3d7","entry":"discretized_gaussian_log_likelihood","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/losses.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cd33283d615fb3d7"}},{"code_sha256_prefix":"a086d6286a40b889","entry":"get_named_beta_schedule","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/gaussian_diffusion.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/gaussian_diffusion.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a086d6286a40b889"}},{"code_sha256_prefix":"e41367ad14ff58fd","entry":"get_param_groups_and_shapes","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/fp16_util.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/fp16_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e41367ad14ff58fd"}},{"code_sha256_prefix":"686a5a7fc55acb4e","entry":"load_data","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"poison_anti_db.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/poison_anti_db.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"686a5a7fc55acb4e"}},{"code_sha256_prefix":"e20dd5102da3b050","entry":"make_master_params","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/fp16_util.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/fp16_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e20dd5102da3b050"}},{"code_sha256_prefix":"cf2798b666b231ca","entry":"normal_kl","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/losses.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/losses.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf2798b666b231ca"}},{"code_sha256_prefix":"64fff1e30802b815","entry":"unflatten_master_params","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/fp16_util.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/fp16_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"64fff1e30802b815"}},{"code_sha256_prefix":"0eb3e94e8635150e","entry":"import_model_class_from_model_name_or_path","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"train_text_to_image_lora.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/train_text_to_image_lora.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0eb3e94e8635150e"}},{"code_sha256_prefix":"2f00b39db5a81466","entry":"import_model_class_from_model_name_or_path","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"poison_adv.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/poison_adv.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2f00b39db5a81466"}},{"code_sha256_prefix":"d234897b8bec8edf","entry":"parse_args","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"poison_adv.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/poison_adv.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d234897b8bec8edf"}},{"code_sha256_prefix":"1ab158c2ed9a599b","entry":"parse_args","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"poison_anti_db.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/poison_anti_db.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ab158c2ed9a599b"}},{"code_sha256_prefix":"e48b90b86b0e1404","entry":"parse_args","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"train_text_to_image_lora.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/train_text_to_image_lora.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e48b90b86b0e1404"}},{"code_sha256_prefix":"53d5be4fdbcfac23","entry":"random_crop_arr","repo":"zhengyuezhao/gridpure","repo_kind":"official","path":"guided_diffusion/image_datasets.py","file_url":"https://github.com/zhengyuezhao/gridpure/blob/HEAD/guided_diffusion/image_datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53d5be4fdbcfac23"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}