Papers › FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images
FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images
Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox
Estimating 3D hand pose from single RGB images is a highly ambiguous problem that relies on an unbiased training dataset. In this paper, we analyze cross-dataset generalization when training on existing datasets. We find that approaches perform well on the datasets they are trained on, but do not generalize to other datasets or in-the-wild scenarios. As a consequence, we introduce the first large-scale, multi-view hand dataset that is accompanied by both 3D hand pose and shape annotations. For annotating this real-world dataset, we propose an iterative, semi-automated `human-in-the-loop' approach, which includes hand fitting optimization to infer both the 3D pose and shape for each sample. We show that methods trained on our dataset consistently perform well when tested on other datasets. Moreover, the dataset allows us to train a network that predicts the full articulated hand shape from a single RGB image. The evaluation set can serve as a benchmark for articulated hand shape estimation.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Datasets
Introduced by this paper, per the archive.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D Hand Pose Estimation | FreiHAND | MANO CNN | PA-F@15mm | 0.934 | #27 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | MANO CNN | PA-F@5mm | 0.516 | #27 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | MANO CNN | PA-MPJPE | 11.0 | #27 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | MANO CNN | PA-MPVPE | 10.9 | #27 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | Zimmermann et al. | PA-F@15mm | 0.935 | #31 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | Zimmermann et al. | PA-F@5mm | 0.529 | #31 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | Zimmermann et al. | PA-MPVPE | 10.7 | #31 of 33 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections