{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adafuse-adaptive-multiview-fusion-for","title":"AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild","arxiv_id":"2010.13302","date":"2020-10-26","proceeding":null,"authors":["Zhe Zhang","Chunyu Wang","Weichao Qiu","Wenhu Qin","Wenjun Zeng"],"abstract":"Occlusion is probably the biggest challenge for human pose estimation in the wild. Typical solutions often rely on intrusive sensors such as IMUs to detect occluded joints. To make the task truly unconstrained, we present AdaFuse, an adaptive multiview fusion method, which can enhance the features in occluded views by leveraging those in visible views. The core of AdaFuse is to determine the point-point correspondence between two views which we solve effectively by exploring the sparsity of the heatmap representation. We also learn an adaptive fusion weight for each camera view to reflect its feature quality in order to reduce the chance that good features are undesirably corrupted by ``bad'' views. The fusion model is trained end-to-end with the pose estimation network, and can be directly applied to new camera configurations without additional adaptation. We extensively evaluate the approach on three public datasets including Human3.6M, Total Capture and CMU Panoptic. It outperforms the state-of-the-arts on all of them. We also create a large scale synthetic dataset Occlusion-Person, which allows us to perform numerical evaluation on the occluded joints, as it provides occlusion labels for every joint in the images. The dataset and code are released at https://github.com/zhezh/adafuse-3d-human-pose.","url_abs":"https://arxiv.org/abs/2010.13302v1","url_pdf":"https://arxiv.org/pdf/2010.13302v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"adafuse-adaptive-multiview-fusion-for","repo_url":"https://github.com/zhezh/adafuse-3d-human-pose","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"adafuse-adaptive-multiview-fusion-for","repo_url":"https://github.com/zhezh/occlusion_person","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"3d-human-pose-estimation","task_name":"3D Human Pose Estimation"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"}],"methods":[{"method_slug":"heatmap","method_name":"Heatmap"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-human-pose-estimation-on-cmu-panoptic","task":"3D Human Pose Estimation","dataset":"Panoptic","model":"AdaFuse","rank_in_archive_order":2,"of":9,"metrics":{"Average MPJPE (mm)":"13.55"},"uses_additional_data":true},{"leaderboard":"/sota/3d-human-pose-estimation-on-total-capture","task":"3D Human Pose Estimation","dataset":"Total Capture","model":"AdaFuse","rank_in_archive_order":1,"of":14,"metrics":{"Average MPJPE (mm)":"19.2"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2010.13302","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.13302"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhezh/adafuse-3d-human-pose","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhezh/occlusion_person","reach":{"status":"ok"}}],"summary":{"ran_fixture":2,"ran_violates":1},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"2fb7d63c04adc2ce","entry":"get_batch_fundamental_mat","repo":"zhezh/adafuse-3d-human-pose","repo_kind":"official","path":"lib/models/adafuse_network.py","file_url":"https://github.com/zhezh/adafuse-3d-human-pose/blob/HEAD/lib/models/adafuse_network.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2fb7d63c04adc2ce"}},{"code_sha256_prefix":"8cf083709518f192","entry":"get_fundamental_mat","repo":"zhezh/adafuse-3d-human-pose","repo_kind":"official","path":"lib/models/adafuse_network.py","file_url":"https://github.com/zhezh/adafuse-3d-human-pose/blob/HEAD/lib/models/adafuse_network.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8cf083709518f192"}},{"code_sha256_prefix":"a957019ca36a6747","entry":"str2bool","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"a957019ca36a6747"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}