{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/responsible-visual-editing","title":"Responsible Visual Editing","arxiv_id":"2404.05580","date":"2024-04-08","proceeding":null,"authors":["Minheng Ni","Yeli Shen","Lei Zhang","WangMeng Zuo"],"abstract":"With recent advancements in visual synthesis, there is a growing risk of encountering images with detrimental effects, such as hate, discrimination, or privacy violations. The research on transforming harmful images into responsible ones remains unexplored. In this paper, we formulate a new task, responsible visual editing, which entails modifying specific concepts within an image to render it more responsible while minimizing changes. However, the concept that needs to be edited is often abstract, making it challenging to locate what needs to be modified and plan how to modify it. To tackle these challenges, we propose a Cognitive Editor (CoEditor) that harnesses the large multimodal model through a two-stage cognitive process: (1) a perceptual cognitive process to focus on what needs to be modified and (2) a behavioral cognitive process to strategize how to modify. To mitigate the negative implications of harmful images on research, we create a transparent and public dataset, AltBear, which expresses harmful information using teddy bears instead of humans. Experiments demonstrate that CoEditor can effectively comprehend abstract concepts within complex scenes and significantly surpass the performance of baseline models for responsible visual editing. We find that the AltBear dataset corresponds well to the harmful content found in real images, offering a consistent experimental evaluation, thereby providing a safer benchmark for future research. Moreover, CoEditor also shows great results in general editing. We release our code and dataset at https://github.com/kodenii/Responsible-Visual-Editing.","url_abs":"https://arxiv.org/abs/2404.05580v1","url_pdf":"https://arxiv.org/pdf/2404.05580v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"responsible-visual-editing","repo_url":"https://github.com/kodenii/responsible-visual-editing","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.05580","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.05580"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/kodenii/Responsible-Visual-Editing","reach":{"status":"ok"}}],"summary":{"ran":9,"unverified":3},"by_repo_kind":{"official":{"samples":12,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":12,"samples":[{"code_sha256_prefix":"7727de04fa5e08e0","entry":"bezier","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"seem/datasets/visual_sampler/polygon.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/seem/datasets/visual_sampler/polygon.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7727de04fa5e08e0"}},{"code_sha256_prefix":"d19823acf1db6d63","entry":"ccw_sort","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"seem/datasets/visual_sampler/polygon.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/seem/datasets/visual_sampler/polygon.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d19823acf1db6d63"}},{"code_sha256_prefix":"2343d983702832ca","entry":"dilate_mask","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"rve_toolkits.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/rve_toolkits.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2343d983702832ca"}},{"code_sha256_prefix":"cb9ab8a6655701f7","entry":"encode_image_from_file","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"gpt4v.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/gpt4v.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cb9ab8a6655701f7"}},{"code_sha256_prefix":"71138ba2dfbe50e1","entry":"encode_image_from_pil","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"gpt4v.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/gpt4v.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"71138ba2dfbe50e1"}},{"code_sha256_prefix":"f0de29e6038e30e8","entry":"get_curve","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"seem/datasets/visual_sampler/polygon.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/seem/datasets/visual_sampler/polygon.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f0de29e6038e30e8"}},{"code_sha256_prefix":"3b46f108f6136ca9","entry":"prepare_inputs","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"gpt4v.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/gpt4v.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3b46f108f6136ca9"}},{"code_sha256_prefix":"9385dc687774b827","entry":"random_accelerate","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"seem/datasets/visual_sampler/mask_generators.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/seem/datasets/visual_sampler/mask_generators.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9385dc687774b827"}},{"code_sha256_prefix":"281b913e3395d94c","entry":"random_move_control_points","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"seem/datasets/visual_sampler/mask_generators.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/seem/datasets/visual_sampler/mask_generators.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"281b913e3395d94c"}},{"code_sha256_prefix":"c453c7f3288f33c5","entry":"build_shape_sampler","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"seem/datasets/visual_sampler/simpleclick_sampler.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/seem/datasets/visual_sampler/simpleclick_sampler.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c453c7f3288f33c5"}},{"code_sha256_prefix":"b47bfeff63213bd4","entry":"get_mask_by_input_strokes","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"seem/datasets/visual_sampler/mask_generators.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/seem/datasets/visual_sampler/mask_generators.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b47bfeff63213bd4"}},{"code_sha256_prefix":"fc812a80d9c0476a","entry":"get_modification_generation_inst","repo":"kodenii/Responsible-Visual-Editing","repo_kind":"official","path":"rve_toolkits.py","file_url":"https://github.com/kodenii/Responsible-Visual-Editing/blob/HEAD/rve_toolkits.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fc812a80d9c0476a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}