{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deformable-model-driven-neural-rendering-for","title":"Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settings","arxiv_id":"2303.13855","date":"2023-03-24","proceeding":"ICCV 2023 1","authors":["Baixin Xu","Jiarui Zhang","Kwan-Yee Lin","Chen Qian","Ying He"],"abstract":"Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To address this, we propose geometry decomposition and adopt a two-stage, coarse-to-fine training strategy, allowing for progressively capturing high-frequency geometric details. We represent 3D human heads using the zero level-set of a combined signed distance field, comprising a smooth template, a non-rigid deformation, and a high-frequency displacement field. The template captures features that are independent of both identity and expression and is co-trained with the deformation network across multiple individuals with sparse and randomly selected views. The displacement field, capturing individual-specific details, undergoes separate training for each person. Our network training does not require 3D supervision or object masks. Experimental results demonstrate the effectiveness and robustness of our geometry decomposition and two-stage training strategy. Our method outperforms existing neural rendering approaches in terms of reconstruction accuracy and novel view synthesis under low-view settings. Moreover, the pre-trained template serves a good initialization for our model when encountering unseen individuals.","url_abs":"https://arxiv.org/abs/2303.13855v2","url_pdf":"https://arxiv.org/pdf/2303.13855v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deformable-model-driven-neural-rendering-for","repo_url":"https://github.com/xubaixinxbx/3dheads","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"deformable-model-driven-neural-rendering-for","repo_url":"https://github.com/xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"neural-rendering","task_name":"Neural Rendering"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.13855","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.13855"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xubaixinxbx/3dheads","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads","reach":null}],"summary":{"ran":1,"unverified":2},"by_repo_kind":{"official":{"samples":3,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"fd0ba98bb3ec4c91","entry":"DeformNetwork","repo":"xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads","repo_kind":"official","path":"code/model/network.py","file_url":"https://github.com/xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads/blob/HEAD/code/model/network.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"fd0ba98bb3ec4c91"}},{"code_sha256_prefix":"6e601d7de96973d2","entry":"DeformTempGeoNetwork","repo":"xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads","repo_kind":"official","path":"code/model/network.py","file_url":"https://github.com/xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads/blob/HEAD/code/model/network.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"6e601d7de96973d2"}},{"code_sha256_prefix":"34199a340c243bad","entry":"ImplicitNetwork","repo":"xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads","repo_kind":"official","path":"code/model/network.py","file_url":"https://github.com/xubaixinxbx/high-fidelity-3d-reconstruction-of-human-heads/blob/HEAD/code/model/network.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"34199a340c243bad"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}