{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fusing-wearable-imus-with-multi-view-images","title":"Fusing Wearable IMUs with Multi-View Images for Human Pose Estimation: A Geometric Approach","arxiv_id":"2003.11163","date":"2020-03-25","proceeding":"CVPR 2020 6","authors":["Zhe Zhang","Chunyu Wang","Wenhu Qin","Wen-Jun Zeng"],"abstract":"We propose to estimate 3D human pose from multi-view images and a few IMUs attached at person's limbs. It operates by firstly detecting 2D poses from the two signals, and then lifting them to the 3D space. We present a geometric approach to reinforce the visual features of each pair of joints based on the IMUs. This notably improves 2D pose estimation accuracy especially when one joint is occluded. We call this approach Orientation Regularized Network (ORN). Then we lift the multi-view 2D poses to the 3D space by an Orientation Regularized Pictorial Structure Model (ORPSM) which jointly minimizes the projection error between the 3D and 2D poses, along with the discrepancy between the 3D pose and IMU orientations. The simple two-step approach reduces the error of the state-of-the-art by a large margin on a public dataset. Our code will be released at https://github.com/CHUNYUWANG/imu-human-pose-pytorch.","url_abs":"https://arxiv.org/abs/2003.11163v2","url_pdf":"https://arxiv.org/pdf/2003.11163v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fusing-wearable-imus-with-multi-view-images","repo_url":"https://github.com/CHUNYUWANG/imu-human-pose-pytorch","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"2d-pose-estimation","task_name":"2D Pose Estimation"},{"task_slug":"3d-absolute-human-pose-estimation","task_name":"3D Absolute Human Pose Estimation"},{"task_slug":"3d-human-pose-estimation","task_name":"3D Human Pose Estimation"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"}],"methods":[{"method_slug":"orn","method_name":"ORN"}],"datasets_introduced":[],"methods_introduced":[{"slug":"orn","name":"ORN","full_name":"Orientation Regularized Network"}],"results":[{"leaderboard":"/sota/3d-absolute-human-pose-estimation-on-total-1","task":"3D Absolute Human Pose Estimation","dataset":"Total Capture","model":"GeoFuse","rank_in_archive_order":1,"of":1,"metrics":{"MPJPE":"24.6"},"uses_additional_data":false},{"leaderboard":"/sota/3d-human-pose-estimation-on-total-capture","task":"3D Human Pose Estimation","dataset":"Total Capture","model":"GeoFuse","rank_in_archive_order":3,"of":14,"metrics":{"Average MPJPE (mm)":"24.6"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2003.11163","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2003.11163"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/CHUNYUWANG/imu-human-pose-pytorch","reach":null}],"summary":{"ran_fixture":1,"ran_draft_wrong":1,"ran_honours":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"da527cd643b6c83c","entry":"apply_bone_offset","repo":"CHUNYUWANG/imu-human-pose-pytorch","repo_kind":"official","path":"lib/models/orn.py","file_url":"https://github.com/CHUNYUWANG/imu-human-pose-pytorch/blob/HEAD/lib/models/orn.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da527cd643b6c83c"}},{"code_sha256_prefix":"66b32977573b37d9","entry":"batch_uv_to_global_with_multi_depth","repo":"CHUNYUWANG/imu-human-pose-pytorch","repo_kind":"official","path":"lib/models/orn.py","file_url":"https://github.com/CHUNYUWANG/imu-human-pose-pytorch/blob/HEAD/lib/models/orn.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"66b32977573b37d9"}},{"code_sha256_prefix":"aefb2632bfa09727","entry":"gen_hm_grid_coords","repo":"CHUNYUWANG/imu-human-pose-pytorch","repo_kind":"official","path":"lib/models/orn.py","file_url":"https://github.com/CHUNYUWANG/imu-human-pose-pytorch/blob/HEAD/lib/models/orn.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aefb2632bfa09727"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}