{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/human-inspired-facial-sketch-synthesis-with","title":"Human-Inspired Facial Sketch Synthesis with Dynamic Adaptation","arxiv_id":"2309.00216","date":"2023-09-01","proceeding":"ICCV 2023 1","authors":["Fei Gao","Yifan Zhu","Chang Jiang","Nannan Wang"],"abstract":"Facial sketch synthesis (FSS) aims to generate a vivid sketch portrait from a given facial photo. Existing FSS methods merely rely on 2D representations of facial semantic or appearance. However, professional human artists usually use outlines or shadings to covey 3D geometry. Thus facial 3D geometry (e.g. depth map) is extremely important for FSS. Besides, different artists may use diverse drawing techniques and create multiple styles of sketches; but the style is globally consistent in a sketch. Inspired by such observations, in this paper, we propose a novel Human-Inspired Dynamic Adaptation (HIDA) method. Specially, we propose to dynamically modulate neuron activations based on a joint consideration of both facial 3D geometry and 2D appearance, as well as globally consistent style control. Besides, we use deformable convolutions at coarse-scales to align deep features, for generating abstract and distinct outlines. Experiments show that HIDA can generate high-quality sketches in multiple styles, and significantly outperforms previous methods, over a large range of challenging faces. Besides, HIDA allows precise style control of the synthesized sketch, and generalizes well to natural scenes and other artistic styles. Our code and results have been released online at: https://github.com/AiArt-HDU/HIDA.","url_abs":"https://arxiv.org/abs/2309.00216v1","url_pdf":"https://arxiv.org/pdf/2309.00216v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"human-inspired-facial-sketch-synthesis-with","repo_url":"https://github.com/aiart-hdu/hida","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-geometry","task_name":"3D geometry"}],"methods":[{"method_slug":"align","method_name":"ALIGN"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.00216","atlas_url":"https://app.syntology.ai/?focus=2309.00216","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.00216"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/AiArt-HDU/HIDA","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"unverified":4},"by_repo_kind":{"official":{"samples":9,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f3e49f0668d3e617","entry":"calculate_activation_statistics","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"evaluation/dirs_fid_score.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/evaluation/dirs_fid_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f3e49f0668d3e617"}},{"code_sha256_prefix":"8d95781d86480c5f","entry":"calculate_frechet_distance","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"evaluation/dirs_fid_score.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/evaluation/dirs_fid_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8d95781d86480c5f"}},{"code_sha256_prefix":"bbf0f49edc553919","entry":"get_activations","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"evaluation/dirs_fid_score.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/evaluation/dirs_fid_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bbf0f49edc553919"}},{"code_sha256_prefix":"9700906f2822ce75","entry":"process_img","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"SIFID/sifid_score_unet.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/SIFID/sifid_score_unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9700906f2822ce75"}},{"code_sha256_prefix":"6dabcfa4fdc06477","entry":"unet","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"SIFID/sifid_unet.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/SIFID/sifid_unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6dabcfa4fdc06477"}},{"code_sha256_prefix":"ad99ad5ed3ed94c9","entry":"calculate_activation_statistics","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"SIFID/sifid_score.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/SIFID/sifid_score.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ad99ad5ed3ed94c9"}},{"code_sha256_prefix":"0def50a351111624","entry":"calculate_frechet_distance","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"SIFID/sifid_score.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/SIFID/sifid_score.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0def50a351111624"}},{"code_sha256_prefix":"747615e2328307c2","entry":"get_activations","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"SIFID/sifid_score.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/SIFID/sifid_score.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"747615e2328307c2"}},{"code_sha256_prefix":"ffc8d712b766ae09","entry":"get_activations","repo":"AiArt-HDU/HIDA","repo_kind":"official","path":"SIFID/sifid_score_unet.py","file_url":"https://github.com/AiArt-HDU/HIDA/blob/HEAD/SIFID/sifid_score_unet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ffc8d712b766ae09"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}