{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mofanerf-morphable-facial-neural-radiance","title":"MoFaNeRF: Morphable Facial Neural Radiance Field","arxiv_id":"2112.02308","date":"2021-12-04","proceeding":null,"authors":["Yiyu Zhuang","Hao Zhu","Xusen Sun","Xun Cao"],"abstract":"We propose a parametric model that maps free-view images into a vector space of coded facial shape, expression and appearance with a neural radiance field, namely Morphable Facial NeRF. Specifically, MoFaNeRF takes the coded facial shape, expression and appearance along with space coordinate and view direction as input to an MLP, and outputs the radiance of the space point for photo-realistic image synthesis. Compared with conventional 3D morphable models (3DMM), MoFaNeRF shows superiority in directly synthesizing photo-realistic facial details even for eyes, mouths, and beards. Also, continuous face morphing can be easily achieved by interpolating the input shape, expression and appearance codes. By introducing identity-specific modulation and texture encoder, our model synthesizes accurate photometric details and shows strong representation ability. Our model shows strong ability on multiple applications including image-based fitting, random generation, face rigging, face editing, and novel view synthesis. Experiments show that our method achieves higher representation ability than previous parametric models, and achieves competitive performance in several applications. To the best of our knowledge, our work is the first facial parametric model built upon a neural radiance field that can be used in fitting, generation and manipulation. The code and data is available at https://github.com/zhuhao-nju/mofanerf.","url_abs":"https://arxiv.org/abs/2112.02308v2","url_pdf":"https://arxiv.org/pdf/2112.02308v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mofanerf-morphable-facial-neural-radiance","repo_url":"https://github.com/zhuhao-nju/mofanerf","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"nerf","task_name":"NeRF"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2112.02308","atlas_url":"https://app.syntology.ai/?focus=2112.02308","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2112.02308"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhuhao-nju/mofanerf","reach":null}],"summary":{"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":4,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1891ac77e42f321f","entry":"load_uvmap","repo":"zhuhao-nju/mofanerf","repo_kind":"official","path":"run_train.py","file_url":"https://github.com/zhuhao-nju/mofanerf/blob/HEAD/run_train.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1891ac77e42f321f"}},{"code_sha256_prefix":"19e5de069d905bb7","entry":"RGB2YUV","repo":"zhuhao-nju/mofanerf","repo_kind":"official","path":"run_fit.py","file_url":"https://github.com/zhuhao-nju/mofanerf/blob/HEAD/run_fit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19e5de069d905bb7"}},{"code_sha256_prefix":"60820080d58b91e1","entry":"YUV2RGB","repo":"zhuhao-nju/mofanerf","repo_kind":"official","path":"run_fit.py","file_url":"https://github.com/zhuhao-nju/mofanerf/blob/HEAD/run_fit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"60820080d58b91e1"}},{"code_sha256_prefix":"280122df5945ba6a","entry":"load_pose","repo":"zhuhao-nju/mofanerf","repo_kind":"official","path":"run_fit.py","file_url":"https://github.com/zhuhao-nju/mofanerf/blob/HEAD/run_fit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"280122df5945ba6a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}