{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sith-single-view-textured-human","title":"SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion","arxiv_id":"2311.15855","date":"2023-11-27","proceeding":"CVPR 2024 1","authors":["Hsuan-I Ho","Jie Song","Otmar Hilliges"],"abstract":"A long-standing goal of 3D human reconstruction is to create lifelike and fully detailed 3D humans from single-view images. The main challenge lies in inferring unknown body shapes, appearances, and clothing details in areas not visible in the images. To address this, we propose SiTH, a novel pipeline that uniquely integrates an image-conditioned diffusion model into a 3D mesh reconstruction workflow. At the core of our method lies the decomposition of the challenging single-view reconstruction problem into generative hallucination and reconstruction subproblems. For the former, we employ a powerful generative diffusion model to hallucinate unseen back-view appearance based on the input images. For the latter, we leverage skinned body meshes as guidance to recover full-body texture meshes from the input and back-view images. SiTH requires as few as 500 3D human scans for training while maintaining its generality and robustness to diverse images. Extensive evaluations on two 3D human benchmarks, including our newly created one, highlighted our method's superior accuracy and perceptual quality in 3D textured human reconstruction. Our code and evaluation benchmark are available at https://ait.ethz.ch/sith","url_abs":"https://arxiv.org/abs/2311.15855v2","url_pdf":"https://arxiv.org/pdf/2311.15855v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sith-single-view-textured-human","repo_url":"https://github.com/SiTH-Diffusion/SiTH","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"lifelike-3d-human-generation","task_name":"Lifelike 3D Human Generation"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-human-reconstruction-on-4d-dress","task":"3D Human Reconstruction","dataset":"4D-DRESS","model":"SiTH_Inner","rank_in_archive_order":7,"of":22,"metrics":{"Chamfer (cm)":"2.110","IoU":"0.755","Normal Consistency":"0.824"},"uses_additional_data":true},{"leaderboard":"/sota/3d-human-reconstruction-on-4d-dress","task":"3D Human Reconstruction","dataset":"4D-DRESS","model":"SiTH_Outer","rank_in_archive_order":8,"of":22,"metrics":{"Chamfer (cm)":"2.322","IoU":"0.749","Normal Consistency":"0.794"},"uses_additional_data":true},{"leaderboard":"/sota/3d-human-reconstruction-on-customhumans","task":"3D Human Reconstruction","dataset":"CustomHumans","model":"SiTH","rank_in_archive_order":1,"of":8,"metrics":{"Chamfer Distance P-to-S":"1.871","Chamfer Distance S-to-P":"2.045","Normal Consistency":"0.826","f-Score":"37.029"},"uses_additional_data":false},{"leaderboard":"/sota/lifelike-3d-human-generation-on-thuman2-0","task":"Lifelike 3D Human Generation","dataset":"THuman2.0 Dataset","model":"SiTH","rank_in_archive_order":3,"of":6,"metrics":{"CLIP Similarity":"0.8978","LPIPS":"0.1396","PSNR":"17.0533","SSIM":"0.8963"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.15855","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.15855"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SiTH-Diffusion/SiTH","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"35f360097277a3c3","entry":"add_margin","repo":"SiTH-Diffusion/SiTH","repo_kind":"official","path":"fit.py","file_url":"https://github.com/SiTH-Diffusion/SiTH/blob/HEAD/fit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"35f360097277a3c3"}},{"code_sha256_prefix":"780134a59aa312e6","entry":"argparse_to_str","repo":"SiTH-Diffusion/SiTH","repo_kind":"official","path":"diffusion/lib/config.py","file_url":"https://github.com/SiTH-Diffusion/SiTH/blob/HEAD/diffusion/lib/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"780134a59aa312e6"}},{"code_sha256_prefix":"65affdb18adae23d","entry":"load_mat","repo":"SiTH-Diffusion/SiTH","repo_kind":"official","path":"demo/load_obj.py","file_url":"https://github.com/SiTH-Diffusion/SiTH/blob/HEAD/demo/load_obj.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65affdb18adae23d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}