{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/make-your-anchor-a-diffusion-based-2d-avatar","title":"Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework","arxiv_id":"2403.16510","date":"2024-03-25","proceeding":"CVPR 2024 1","authors":["Ziyao Huang","Fan Tang","Yong Zhang","Xiaodong Cun","Juan Cao","Jintao Li","Tong-Yee Lee"],"abstract":"Despite the remarkable process of talking-head-based avatar-creating solutions, directly generating anchor-style videos with full-body motions remains challenging. In this study, we propose Make-Your-Anchor, a novel system necessitating only a one-minute video clip of an individual for training, subsequently enabling the automatic generation of anchor-style videos with precise torso and hand movements. Specifically, we finetune a proposed structure-guided diffusion model on input video to render 3D mesh conditions into human appearances. We adopt a two-stage training strategy for the diffusion model, effectively binding movements with specific appearances. To produce arbitrary long temporal video, we extend the 2D U-Net in the frame-wise diffusion model to a 3D style without additional training cost, and a simple yet effective batch-overlapped temporal denoising module is proposed to bypass the constraints on video length during inference. Finally, a novel identity-specific face enhancement module is introduced to improve the visual quality of facial regions in the output videos. Comparative experiments demonstrate the effectiveness and superiority of the system in terms of visual quality, temporal coherence, and identity preservation, outperforming SOTA diffusion/non-diffusion methods. Project page: \\url{https://github.com/ICTMCG/Make-Your-Anchor}.","url_abs":"https://arxiv.org/abs/2403.16510v1","url_pdf":"https://arxiv.org/pdf/2403.16510v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"make-your-anchor-a-diffusion-based-2d-avatar","repo_url":"https://github.com/ictmcg/make-your-anchor","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"denoising","task_name":"Denoising"}],"methods":[{"method_slug":"clip","method_name":"CLIP"},{"method_slug":"concatenated-skip-connection","method_name":"Concatenated Skip Connection"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"u-net","method_name":"U-Net"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.16510","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.16510"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ictmcg/make-your-anchor","reach":{"status":"ok"}}],"summary":{"ran":4,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":8,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"6adb0604c88c90e8","entry":"align","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/face_alignment.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/face_alignment.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6adb0604c88c90e8"}},{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/resnet.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"325b8d54f52e2421","entry":"create_layer_basic","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/resnet.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"325b8d54f52e2421"}},{"code_sha256_prefix":"07561355dba35f8b","entry":"dilate","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/get_mask.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/get_mask.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"07561355dba35f8b"}},{"code_sha256_prefix":"f0ccd5af146c0af8","entry":"image_process","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/inference_face_inpainting.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/inference_face_inpainting.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f0ccd5af146c0af8"}},{"code_sha256_prefix":"ca262595b1d713f8","entry":"get_down_block","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/models/controlnet_unet_blocks.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/models/controlnet_unet_blocks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ca262595b1d713f8"}},{"code_sha256_prefix":"1ff37da770453c6d","entry":"get_up_block","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/models/controlnet_unet_blocks.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/models/controlnet_unet_blocks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1ff37da770453c6d"}},{"code_sha256_prefix":"da94debb8019ad46","entry":"zero_module","repo":"ictmcg/make-your-anchor","repo_kind":"official","path":"inference/models/controlnet.py","file_url":"https://github.com/ictmcg/make-your-anchor/blob/HEAD/inference/models/controlnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"da94debb8019ad46"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}