Papers › WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild
WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild
Rolandos Alexandros Potamias, Jinglei Zhang, Jiankang Deng, Stefanos Zafeiriou
In recent years, 3D hand pose estimation methods have garnered significant attention due to their extensive applications in human-computer interaction, virtual reality, and robotics. In contrast, there has been a notable gap in hand detection pipelines, posing significant challenges in constructing effective real-world multi-hand reconstruction systems. In this work, we present a data-driven pipeline for efficient multi-hand reconstruction in the wild. The proposed pipeline is composed of two components: a real-time fully convolutional hand localization and a high-fidelity transformer-based 3D hand reconstruction model. To tackle the limitations of previous methods and build a robust and stable detection network, we introduce a large-scale dataset with over than 2M in-the-wild hand images with diverse lighting, illumination, and occlusion conditions. Our approach outperforms previous methods in both efficiency and accuracy on popular 2D and 3D benchmarks. Finally, we showcase the effectiveness of our pipeline to achieve smooth 3D hand tracking from monocular videos, without utilizing any temporal components. Code, models, and dataset are available https://rolpotamias.github.io/WiLoR.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D Hand Pose Estimation | FreiHAND | WiLoR | PA-F@15mm | 0.993 | #3 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | WiLoR | PA-F@5mm | 0.825 | #3 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | WiLoR | PA-MPJPE | 5.5 | #3 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | FreiHAND | WiLoR | PA-MPVPE | 5.1 | #3 of 33 | Archive leaderboard | report |
| 3D Hand Pose Estimation | HO-3D v2 | WiLoR | AUC_J | 0.851 | #3 of 24 | Archive leaderboard | report |
| 3D Hand Pose Estimation | HO-3D v2 | WiLoR | AUC_V | 0.846 | #3 of 24 | Archive leaderboard | report |
| 3D Hand Pose Estimation | HO-3D v2 | WiLoR | F@15mm | 0.983 | #3 of 24 | Archive leaderboard | report |
| 3D Hand Pose Estimation | HO-3D v2 | WiLoR | F@5mm | 0.646 | #3 of 24 | Archive leaderboard | report |
| 3D Hand Pose Estimation | HO-3D v2 | WiLoR | PA-MPJPE (mm) | 7.5 | #3 of 24 | Archive leaderboard | report |
| 3D Hand Pose Estimation | HO-3D v2 | WiLoR | PA-MPVPE | 7.7 | #3 of 24 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections