{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/vid2avatar-3d-avatar-reconstruction-from","title":"Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition","arxiv_id":"2302.11566","date":"2023-02-22","proceeding":"CVPR 2023 1","authors":["Chen Guo","Tianjian Jiang","Xu Chen","Jie Song","Otmar Hilliges"],"abstract":"We present Vid2Avatar, a method to learn human avatars from monocular in-the-wild videos. Reconstructing humans that move naturally from monocular in-the-wild videos is difficult. Solving it requires accurately separating humans from arbitrary backgrounds. Moreover, it requires reconstructing detailed 3D surface from short video sequences, making it even more challenging. Despite these challenges, our method does not require any groundtruth supervision or priors extracted from large datasets of clothed human scans, nor do we rely on any external segmentation modules. Instead, it solves the tasks of scene decomposition and surface reconstruction directly in 3D by modeling both the human and the background in the scene jointly, parameterized via two separate neural fields. Specifically, we define a temporally consistent human representation in canonical space and formulate a global optimization over the background model, the canonical human shape and texture, and per-frame human pose parameters. A coarse-to-fine sampling strategy for volume rendering and novel objectives are introduced for a clean separation of dynamic human and static background, yielding detailed and robust 3D human geometry reconstructions. We evaluate our methods on publicly available datasets and show improvements over prior art.","url_abs":"https://arxiv.org/abs/2302.11566v1","url_pdf":"https://arxiv.org/pdf/2302.11566v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"vid2avatar-3d-avatar-reconstruction-from","repo_url":"https://github.com/MoyGcc/vid2avatar","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-human-reconstruction","task_name":"3D Human Reconstruction"},{"task_slug":"surface-reconstruction","task_name":"Surface Reconstruction"},{"task_slug":"global-optimization","task_name":"global-optimization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-human-reconstruction-on-4d-dress","task":"3D Human Reconstruction","dataset":"4D-DRESS","model":"Vid2Avatar_Inner","rank_in_archive_order":19,"of":22,"metrics":{"Chamfer (cm)":"2.870","IoU":" 0.772","Normal Consistency":"0.750"},"uses_additional_data":false},{"leaderboard":"/sota/3d-human-reconstruction-on-4d-dress","task":"3D Human Reconstruction","dataset":"4D-DRESS","model":"Vid2Avatar_Outer","rank_in_archive_order":22,"of":22,"metrics":{"Chamfer (cm)":"4.027","IoU":"0.745","Normal Consistency":"0.683"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2302.11566","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.11566"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MoyGcc/vid2avatar","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":7},"by_repo_kind":{"official":{"samples":7,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"66473bc0db1ad9b6","entry":"estimate_translation_cv2","repo":"MoyGcc/vid2avatar","repo_kind":"official","path":"preprocessing/preprocessing_utils.py","file_url":"https://github.com/MoyGcc/vid2avatar/blob/HEAD/preprocessing/preprocessing_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"66473bc0db1ad9b6"}},{"code_sha256_prefix":"2cfa68461442724d","entry":"get_bbox_center","repo":"MoyGcc/vid2avatar","repo_kind":"official","path":"preprocessing/run_openpose.py","file_url":"https://github.com/MoyGcc/vid2avatar/blob/HEAD/preprocessing/run_openpose.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2cfa68461442724d"}},{"code_sha256_prefix":"ef76c0d2137da237","entry":"get_center_point","repo":"MoyGcc/vid2avatar","repo_kind":"official","path":"preprocessing/normalize_cameras.py","file_url":"https://github.com/MoyGcc/vid2avatar/blob/HEAD/preprocessing/normalize_cameras.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef76c0d2137da237"}},{"code_sha256_prefix":"5a5d56a98920d8db","entry":"pose_temporal_loss","repo":"MoyGcc/vid2avatar","repo_kind":"official","path":"preprocessing/loss.py","file_url":"https://github.com/MoyGcc/vid2avatar/blob/HEAD/preprocessing/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5a5d56a98920d8db"}},{"code_sha256_prefix":"dfdc897db8cbf77c","entry":"render_trimesh","repo":"MoyGcc/vid2avatar","repo_kind":"official","path":"preprocessing/preprocessing_utils.py","file_url":"https://github.com/MoyGcc/vid2avatar/blob/HEAD/preprocessing/preprocessing_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dfdc897db8cbf77c"}},{"code_sha256_prefix":"9e85c5e2bf9ccd61","entry":"skinning","repo":"MoyGcc/vid2avatar","repo_kind":"official","path":"code/lib/model/deformer.py","file_url":"https://github.com/MoyGcc/vid2avatar/blob/HEAD/code/lib/model/deformer.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e85c5e2bf9ccd61"}},{"code_sha256_prefix":"d5dd5e6e08a6dc7c","entry":"smpl_to_pose","repo":"MoyGcc/vid2avatar","repo_kind":"official","path":"preprocessing/preprocessing_utils.py","file_url":"https://github.com/MoyGcc/vid2avatar/blob/HEAD/preprocessing/preprocessing_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d5dd5e6e08a6dc7c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}