Papers › 3D Hand Reconstruction via Aggregating Intra and Inter Graphs Guided by Prior...
3D Hand Reconstruction via Aggregating Intra and Inter Graphs Guided by Prior Knowledge for Hand-Object Interaction Scenario
Feng Shuang, Wenbo He, Shaodong Li
Recently, 3D hand reconstruction has gained more attention in human-computer cooperation, especially for hand-object interaction scenario. However, it still remains huge challenge due to severe hand-occlusion caused by interaction, which contain the balance of accuracy and physical plausibility, highly nonlinear mapping of model parameters and occlusion feature enhancement. To overcome these issues, we propose a 3D hand reconstruction network combining the benefits of model-based and model-free approaches to balance accuracy and physical plausibility for hand-object interaction scenario. Firstly, we present a novel MANO pose parameters regression module from 2D joints directly, which avoids the process of highly nonlinear mapping from abstract image feature and no longer depends on accurate 3D joints. Moreover, we further propose a vertex-joint mutual graph-attention model guided by MANO to jointly refine hand meshes and joints, which model the dependencies of vertex-vertex and joint-joint and capture the correlation of vertex-joint for aggregating intra-graph and inter-graph node features respectively. The experimental results demonstrate that our method achieves a competitive performance on recently benchmark datasets HO3DV2 and Dex-YCB, and outperforms all only model-base approaches and model-free approaches.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D Hand Pose Estimation | DexYCB | SemGCN | Average MPJPE (mm) | 13.2 | #5 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | SemGCN | MPVPE | 12.4 | #5 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | SemGCN | PA-MPVPE | 5.4 | #5 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | SemGCN | PA-VAUC | - | #5 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | SemGCN | Procrustes-Aligned MPJPE | 5.6 | #5 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | DexYCB | SemGCN | VAUC | - | #5 of 11 | Archive leaderboard | report |
| 3D Hand Pose Estimation | HO-3D v2 | SemGCN | PA-MPJPE (mm) | 8.8 | #8 of 24 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections