{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/co-evolution-of-pose-and-mesh-for-3d-human","title":"Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Video","arxiv_id":"2308.10305","date":"2023-08-20","proceeding":"ICCV 2023 1","authors":["Yingxuan You","Hong Liu","Ti Wang","Wenhao Li","Runwei Ding","Xia Li"],"abstract":"Despite significant progress in single image-based 3D human mesh recovery, accurately and smoothly recovering 3D human motion from a video remains challenging. Existing video-based methods generally recover human mesh by estimating the complex pose and shape parameters from coupled image features, whose high complexity and low representation ability often result in inconsistent pose motion and limited shape patterns. To alleviate this issue, we introduce 3D pose as the intermediary and propose a Pose and Mesh Co-Evolution network (PMCE) that decouples this task into two parts: 1) video-based 3D human pose estimation and 2) mesh vertices regression from the estimated 3D pose and temporal image feature. Specifically, we propose a two-stream encoder that estimates mid-frame 3D pose and extracts a temporal image feature from the input image sequence. In addition, we design a co-evolution decoder that performs pose and mesh interactions with the image-guided Adaptive Layer Normalization (AdaLN) to make pose and mesh fit the human body shape. Extensive experiments demonstrate that the proposed PMCE outperforms previous state-of-the-art methods in terms of both per-frame accuracy and temporal consistency on three benchmark datasets: 3DPW, Human3.6M, and MPI-INF-3DHP. Our code is available at https://github.com/kasvii/PMCE.","url_abs":"https://arxiv.org/abs/2308.10305v1","url_pdf":"https://arxiv.org/pdf/2308.10305v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"co-evolution-of-pose-and-mesh-for-3d-human","repo_url":"https://github.com/kasvii/pmce","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-human-pose-estimation","task_name":"3D Human Pose Estimation"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"human-mesh-recovery","task_name":"Human Mesh Recovery"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"}],"methods":[{"method_slug":"layer-normalization","method_name":"Layer Normalization"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2308.10305","atlas_url":"https://app.syntology.ai/?focus=2308.10305","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.10305"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kasvii/pmce","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/kasvii/PMCE","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":19,"ran_honours":1,"unverified":4},"by_repo_kind":{"official":{"samples":24,"ran":20,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9b30f6afe448da82","entry":"align_kps_bbox","repo":"kasvii/pmce","repo_kind":"official","path":"lib/coord_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/coord_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b30f6afe448da82"}},{"code_sha256_prefix":"562787578bf4c568","entry":"batch_rodrigues","repo":"kasvii/pmce","repo_kind":"official","path":"lib/geometry.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/geometry.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"562787578bf4c568"}},{"code_sha256_prefix":"4711f9277f0b013f","entry":"build_adj","repo":"kasvii/pmce","repo_kind":"official","path":"lib/graph_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/graph_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4711f9277f0b013f"}},{"code_sha256_prefix":"b36ecfba280a2c8f","entry":"build_verts_joints_relation","repo":"kasvii/pmce","repo_kind":"official","path":"lib/graph_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/graph_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b36ecfba280a2c8f"}},{"code_sha256_prefix":"e2470ef9a218f08e","entry":"build_verts_joints_relation_and_adj","repo":"kasvii/pmce","repo_kind":"official","path":"lib/graph_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/graph_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e2470ef9a218f08e"}},{"code_sha256_prefix":"dabca14d8855c9b6","entry":"check_data_pararell","repo":"kasvii/pmce","repo_kind":"official","path":"lib/funcs_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/funcs_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dabca14d8855c9b6"}},{"code_sha256_prefix":"58d59e9d2a8a0240","entry":"compute_accel","repo":"kasvii/pmce","repo_kind":"official","path":"lib/eval_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/eval_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"58d59e9d2a8a0240"}},{"code_sha256_prefix":"35c6e596e9bc4bb2","entry":"compute_error_accel","repo":"kasvii/pmce","repo_kind":"official","path":"lib/eval_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/eval_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"35c6e596e9bc4bb2"}},{"code_sha256_prefix":"8e5bf3cf235ab46d","entry":"compute_error_verts","repo":"kasvii/pmce","repo_kind":"official","path":"lib/eval_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/eval_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8e5bf3cf235ab46d"}},{"code_sha256_prefix":"f6b944f50d3f15ae","entry":"count_parameters","repo":"kasvii/pmce","repo_kind":"official","path":"lib/funcs_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/funcs_utils.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6b944f50d3f15ae"}},{"code_sha256_prefix":"f68a67677086aa1c","entry":"flip_2d_joint","repo":"kasvii/pmce","repo_kind":"official","path":"lib/aug_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/aug_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f68a67677086aa1c"}},{"code_sha256_prefix":"912d2d6834cd5bb4","entry":"get_bbox","repo":"kasvii/pmce","repo_kind":"official","path":"lib/coord_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/coord_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"912d2d6834cd5bb4"}},{"code_sha256_prefix":"fb1932bf89bbc410","entry":"get_center_scale","repo":"kasvii/pmce","repo_kind":"official","path":"lib/coord_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/coord_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fb1932bf89bbc410"}},{"code_sha256_prefix":"628bdc932dbc5c3a","entry":"keypoint_hflip","repo":"kasvii/pmce","repo_kind":"official","path":"lib/_kp_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/_kp_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"628bdc932dbc5c3a"}},{"code_sha256_prefix":"8f4f91059432f0a5","entry":"lr_warmup","repo":"kasvii/pmce","repo_kind":"official","path":"lib/funcs_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/funcs_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8f4f91059432f0a5"}},{"code_sha256_prefix":"ae4ca2a089067b0a","entry":"quat2mat","repo":"kasvii/pmce","repo_kind":"official","path":"lib/geometry.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/geometry.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae4ca2a089067b0a"}},{"code_sha256_prefix":"c014c11248a4891f","entry":"rodrigues","repo":"kasvii/pmce","repo_kind":"official","path":"lib/geometry.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/geometry.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c014c11248a4891f"}},{"code_sha256_prefix":"b1f45d51790449fc","entry":"rotate_2d","repo":"kasvii/pmce","repo_kind":"official","path":"lib/aug_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/aug_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1f45d51790449fc"}},{"code_sha256_prefix":"dcd1df7e1eda2855","entry":"split_into_chunks_mesh","repo":"kasvii/pmce","repo_kind":"official","path":"lib/_img_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/_img_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dcd1df7e1eda2855"}},{"code_sha256_prefix":"e0dada0a1ecc1a8a","entry":"transform_joint_to_other_db","repo":"kasvii/pmce","repo_kind":"official","path":"lib/aug_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/aug_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0dada0a1ecc1a8a"}},{"code_sha256_prefix":"708170c867250f8e","entry":"PMCE","repo":"kasvii/PMCE","repo_kind":"official","path":"lib/models/PMCE.py","file_url":"https://github.com/kasvii/PMCE/blob/HEAD/lib/models/PMCE.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"708170c867250f8e"}},{"code_sha256_prefix":"dd00dcfc40bb21b0","entry":"convert_kps","repo":"kasvii/pmce","repo_kind":"official","path":"lib/_kp_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/_kp_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd00dcfc40bb21b0"}},{"code_sha256_prefix":"82f116b8b840fe3c","entry":"get_perm_idxs","repo":"kasvii/pmce","repo_kind":"official","path":"lib/_kp_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/_kp_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82f116b8b840fe3c"}},{"code_sha256_prefix":"c6783f5ea49aeb6f","entry":"split_into_chunks_pose","repo":"kasvii/pmce","repo_kind":"official","path":"lib/_img_utils.py","file_url":"https://github.com/kasvii/pmce/blob/HEAD/lib/_img_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c6783f5ea49aeb6f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}