Papers › UV-Based 3D Hand-Object Reconstruction with Grasp Optimization

UV-Based 3D Hand-Object Reconstruction with Grasp Optimization

24 Nov 2022arXiv:2211.13429archive 2025-07-28

Ziwei Yu, Linlin Yang, You Xie, Ping Chen, Angela Yao

We propose a novel framework for 3D hand shape reconstruction and hand-object grasp optimization from a single RGB image. The representation of hand-object contact regions is critical for accurate reconstructions. Instead of approximating the contact regions with sparse points, as in previous works, we propose a dense representation in the form of a UV coordinate map. Furthermore, we introduce inference-time optimization to fine-tune the grasp and improve interactions between the hand and the object. Our pipeline increases hand shape reconstruction accuracy and produces a vibrant hand texture. Experiments on datasets such as Ho3D, FreiHAND, and DexYCB reveal that our proposed method outperforms the state-of-the-art.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Hand Pose EstimationObjectObject Reconstruction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Hand Pose Estimation HO-3D v3 Yu et al. PA-MPJPE 10.8 #6 of 8 Archive leaderboard report
3D Hand Pose Estimation HO-3D v3 Yu et al. PA-MPVPE 10.4 #6 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections