Papers › Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraints
Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraints
Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz
Estimating 3D hand pose from 2D images is a difficult, inverse problem due to the inherent scale and depth ambiguities. Current state-of-the-art methods train fully supervised deep neural networks with 3D ground-truth data. However, acquiring 3D annotations is expensive, typically requiring calibrated multi-view setups or labor intensive manual annotations. While annotations of 2D keypoints are much easier to obtain, how to efficiently leverage such weakly-supervised data to improve the task of 3D hand pose prediction remains an important open question. The key difficulty stems from the fact that direct application of additional 2D supervision mostly benefits the 2D proxy objective but does little to alleviate the depth and scale ambiguities. Embracing this challenge we propose a set of novel losses. We show by extensive experiments that our proposed constraints significantly reduce the depth ambiguity and allow the network to more effectively leverage additional 2D annotated images. For example, on the challenging freiHAND dataset using additional 2D annotation without our proposed biomechanical constraints reduces the depth error by only 15%, whereas the error is reduced significantly by 50% when the proposed biomechanical constraints are used.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D Hand Pose Estimation | DexYCB | BMC | Average MPJPE (mm) | 17.3 | #11 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | BMC | MPVPE | - | #11 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | BMC | PA-MPVPE | - | #11 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | BMC | PA-VAUC | - | #11 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | BMC | Procrustes-Aligned MPJPE | 6.83 | #11 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | BMC | VAUC | - | #11 of 11 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections