{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/headstudio-text-to-animatable-head-avatars","title":"HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting","arxiv_id":"2402.06149","date":"2024-02-09","proceeding":null,"authors":["Zhenglin Zhou","Fan Ma","Hehe Fan","Zongxin Yang","Yi Yang"],"abstract":"Creating digital avatars from textual prompts has long been a desirable yet challenging task. Despite the promising results achieved with 2D diffusion priors, current methods struggle to create high-quality and consistent animated avatars efficiently. Previous animatable head models like FLAME have difficulty in accurately representing detailed texture and geometry. Additionally, high-quality 3D static representations face challenges in semantically driving with dynamic priors. In this paper, we introduce \\textbf{HeadStudio}, a novel framework that utilizes 3D Gaussian splatting to generate realistic and animatable avatars from text prompts. Firstly, we associate 3D Gaussians with animatable head prior model, facilitating semantic animation on high-quality 3D representations. To ensure consistent animation, we further enhance the optimization from initialization, distillation, and regularization to jointly learn the shape, texture, and animation. Extensive experiments demonstrate the efficacy of HeadStudio in generating animatable avatars from textual prompts, exhibiting appealing appearances. The avatars are capable of rendering high-quality real-time ($\\geq 40$ fps) novel views at a resolution of 1024. Moreover, These avatars can be smoothly driven by real-world speech and video. We hope that HeadStudio can enhance digital avatar creation and gain popularity in the community. Code is at: https://github.com/ZhenglinZhou/HeadStudio.","url_abs":"https://arxiv.org/abs/2402.06149v2","url_pdf":"https://arxiv.org/pdf/2402.06149v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"headstudio-text-to-animatable-head-avatars","repo_url":"https://github.com/zhenglinzhou/headstudio","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.06149","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.06149"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhenglinzhou/headstudio","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/ZhenglinZhou/HeadStudio","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"ran":4,"unverified":3},"by_repo_kind":{"official":{"samples":8,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c56b7ef16f309a45","entry":"gaussian","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"gaussiansplatting/utils/loss_utils.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/gaussiansplatting/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c56b7ef16f309a45"}},{"code_sha256_prefix":"dcc7d8db6ac85aa5","entry":"get_c2w","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"animation.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/animation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dcc7d8db6ac85aa5"}},{"code_sha256_prefix":"ac0e42d6fbcfbbe6","entry":"l1_loss","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"gaussiansplatting/utils/loss_utils.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/gaussiansplatting/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac0e42d6fbcfbbe6"}},{"code_sha256_prefix":"8c3b0f873ba11813","entry":"l2_loss","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"gaussiansplatting/utils/loss_utils.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/gaussiansplatting/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c3b0f873ba11813"}},{"code_sha256_prefix":"cdd00787894554b5","entry":"readImages","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"gaussiansplatting/metrics.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/gaussiansplatting/metrics.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cdd00787894554b5"}},{"code_sha256_prefix":"2264ffba1d2ef541","entry":"batch_gs_render","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"animation.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/animation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2264ffba1d2ef541"}},{"code_sha256_prefix":"40c6045859b09953","entry":"batch_gs_render","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"animation_TalkSHOW.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/animation_TalkSHOW.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40c6045859b09953"}},{"code_sha256_prefix":"644f4722f144360f","entry":"batch_mesh_render","repo":"ZhenglinZhou/HeadStudio","repo_kind":"official","path":"animation.py","file_url":"https://github.com/ZhenglinZhou/HeadStudio/blob/HEAD/animation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"644f4722f144360f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}