Papers › Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation

Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation

23 Nov 2020arXiv:2011.11534archive 2025-07-28

Gyeongsik Moon, Hongsuk Choi, Kyoung Mu Lee

Whole-body 3D human mesh estimation aims to reconstruct the 3D human body, hands, and face simultaneously. Although several methods have been proposed, accurate prediction of 3D hands, which consist of 3D wrist and fingers, still remains challenging due to two reasons. First, the human kinematic chain has not been carefully considered when predicting the 3D wrists. Second, previous works utilize body features for the 3D fingers, where the body feature barely contains finger information. To resolve the limitations, we present Hand4Whole, which has two strong points over previous works. First, we design Pose2Pose, a module that utilizes joint features for 3D joint rotations. Using Pose2Pose, Hand4Whole utilizes hand MCP joint features to predict 3D wrists as MCP joints largely contribute to 3D wrist rotations in the human kinematic chain. Second, Hand4Whole discards the body feature when predicting 3D finger rotations. Our Hand4Whole is trained in an end-to-end manner and produces much better 3D hand results than previous whole-body 3D human mesh estimation methods. The codes are available here at https://github.com/mks0601/Hand4Whole_RELEASE.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

mks0601/Hand4Whole_RELEASE officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Hand Pose Estimation3D Human Pose Estimation3D Human ReconstructionHand Pose EstimationPose EstimationPose Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Hand Pose Estimation FreiHAND Hand4Whole PA-F@15mm 0.971 #24 of 33 Archive leaderboard report
3D Hand Pose Estimation FreiHAND Hand4Whole PA-F@5mm 0.664 #24 of 33 Archive leaderboard report
3D Hand Pose Estimation FreiHAND Hand4Whole PA-MPJPE 7.7 #24 of 33 Archive leaderboard report
3D Hand Pose Estimation FreiHAND Hand4Whole PA-MPVPE 7.7 #24 of 33 Archive leaderboard report
3D Human Pose Estimation 3DPW Hand4Whole PA-MPJPE 54.4 #82 of 119 Archive leaderboard report
3D Human Pose Estimation UBody Hand4Whole PA-PVE-All 44.8 #4 of 4 Archive leaderboard report
3D Human Pose Estimation UBody Hand4Whole PA-PVE-Face 2.8 #4 of 4 Archive leaderboard report
3D Human Pose Estimation UBody Hand4Whole PA-PVE-Hands 8.9 #4 of 4 Archive leaderboard report
3D Human Pose Estimation UBody Hand4Whole PVE-All 104.1 #4 of 4 Archive leaderboard report
3D Human Pose Estimation UBody Hand4Whole PVE-Face 27.0 #4 of 4 Archive leaderboard report
3D Human Pose Estimation UBody Hand4Whole PVE-Hands 45.7 #4 of 4 Archive leaderboard report
3D Human Reconstruction AGORA Hand4Whole PA-MPVPE 73.2 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) Hand4Whole PA V2V (mm), face 5.8 #1 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) Hand4Whole PA V2V (mm), left hand 10.8 #1 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) Hand4Whole PA V2V (mm), whole body 50.3 #1 of 5 Archive leaderboard report
Hand Pose Estimation 3DPW Hand4Whole MPJPE 86.6 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections