Papers › H3WB: Human3.6M 3D WholeBody Dataset and Benchmark

H3WB: Human3.6M 3D WholeBody Dataset and Benchmark

28 Nov 2022ICCV 2023 1arXiv:2211.15692archive 2025-07-28

Yue Zhu, Nermin Samet, David Picard

We present a benchmark for 3D human whole-body pose estimation, which involves identifying accurate 3D keypoints on the entire human body, including face, hands, body, and feet. Currently, the lack of a fully annotated and accurate 3D whole-body dataset results in deep networks being trained separately on specific body parts, which are combined during inference. Or they rely on pseudo-groundtruth provided by parametric body models which are not as accurate as detection based methods. To overcome these issues, we introduce the Human3.6M 3D WholeBody (H3WB) dataset, which provides whole-body annotations for the Human3.6M dataset using the COCO Wholebody layout. H3WB comprises 133 whole-body keypoint annotations on 100K images, made possible by our new multi-view pipeline. We also propose three tasks: i) 3D whole-body pose lifting from 2D complete whole-body pose, ii) 3D whole-body pose lifting from 2D incomplete whole-body pose, and iii) 3D whole-body pose estimation from a single RGB image. Additionally, we report several baselines from popular methods for these tasks. Furthermore, we also provide automated 3D whole-body annotations of TotalCapture and experimentally show that when used with H3WB it helps to improve the performance. Code and dataset is available at https://github.com/wholebody3d/wholebody3d

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

wholebody3d/wholebody3d officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Facial Landmark Localization3D Hand Pose Estimation3D Human Pose EstimationPose Estimation

Datasets

Introduced by this paper, per the archive.

H3WB

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Facial Landmark Localization H3WB Large SimpleBaseline Average MPJPE (mm) 14.6 #2 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB Jointformer Average MPJPE (mm) 17.8 #4 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB CanonPose + 3D supervision Average MPJPE (mm) 17.9 #5 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB Large SimpleBaseline Average MPJPE (mm) 19.8 #6 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB Jointformer Average MPJPE (mm) 19.8 #7 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB CPN + Jointformer Average MPJPE (mm) 20.7 #8 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB CanonPose + 3D supervision Average MPJPE (mm) 22.2 #9 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB CanonPose Average MPJPE (mm) 24.6 #10 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB SimpleBaseline Average MPJPE (mm) 24.6 #11 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB Resnet50 Average MPJPE (mm) 26.3 #12 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB CanonPose Average MPJPE (mm) 31.9 #13 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB SHN + SimpleBaseline Average MPJPE (mm) 32.5 #14 of 15 Archive leaderboard report
3D Facial Landmark Localization H3WB SimpleBaseline Average MPJPE (mm) 34.0 #15 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB Large SimpleBaseline Average MPJPE (mm) 31.7 #3 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB CanonPose + 3D supervision Average MPJPE (mm) 38.3 #4 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB SimpleBaseline Average MPJPE (mm) 42.5 #5 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB Jointformer Average MPJPE (mm) 43.7 #6 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB Large SimpleBaseline Average MPJPE (mm) 44.8 #7 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB CanonPose + 3D supervision Average MPJPE (mm) 47.4 #8 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB CanonPose Average MPJPE (mm) 48.9 #9 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB Jointformer Average MPJPE (mm) 53.5 #10 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB CanonPose Average MPJPE (mm) 56.2 #11 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB CPN + Jointformer Average MPJPE (mm) 56.9 #12 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB Resnet50 Average MPJPE (mm) 63.1 #13 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB SHN + SimpleBaseline Average MPJPE (mm) 64.3 #14 of 15 Archive leaderboard report
3D Hand Pose Estimation H3WB SimpleBaseline Average MPJPE (mm) 83.4 #15 of 15 Archive leaderboard report
3D Human Pose Estimation H3WB Jointformer MPJPE 84.9 #5 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB Jointformer MPJPE 103.0 #6 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB Large SimpleBaseline MPJPE 112.6 #7 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB CanonPose + 3D supervision MPJPE 117.5 #8 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB SimpleBaseline MPJPE 125.7 #9 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB Large SimpleBaseline MPJPE 131.6 #10 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB CPN + Jointformer MPJPE 142.8 #11 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB Resnet50 MPJPE 151.6 #12 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB CanonPose + 3D supervision MPJPE 155.9 #13 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB SHN + SimpleBaseline MPJPE 189.6 #14 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB CanonPose MPJPE 193.7 #15 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB SimpleBaseline MPJPE 252.0 #16 of 17 Archive leaderboard report
3D Human Pose Estimation H3WB CanonPose MPJPE 264.4 #17 of 17 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections