Browse State-of-the-Art › hand-object pose
hand-object pose
18 papers with code · 2 benchmarks · 4 datasets archive 2025-07-28
6D pose estimation of hand and object
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): DexYCB (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| DexYCB (9 rows) | HOISDF | HOISDF: Constraining 3D Hand-Object Pose Estimation with Global... | code | Syntology official (archive's flag): 16 ran · 16 ran (of which 2 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 8 where Syntology's instrument failed) · 7 unverified | Compare |
| HO-3D v2 (9 rows) | HOISDF | HOISDF: Constraining 3D Hand-Object Pose Estimation with Global... | code | Syntology official (archive's flag): 16 ran · 16 ran (of which 2 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 8 where Syntology's instrument failed) · 7 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 34 · with a code link: 18 · where Syntology ran a sample: 5 (5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (5 of 34 tagged: 5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 34 of 34, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
2 Jul 2019 4 repositories listedThis dataset is currently made of 77, 558 frames, 68 sequences, 10 persons, and 10 objects.
-
11 Apr 2019 3 repositories listedPrevious work has made significant progress towards reconstruction of hand poses and object shapes in isolation.
-
26 Jul 2022 2 repositories listedWe show that such aligned SDFs better focus on reconstructing shape details and improve reconstruction accuracy both for hands and objects.
-
12 Sep 2021 2 repositories listedIn contrast, data synthesis can easily ensure those diversities separately.
-
10 Jun 2024 1 repository listedWe introduce a data capture system and a new dataset, HO-Cap, for 3D reconstruction and pose tracking of hands and objects in videos.
-
26 Feb 2024 1 repository listed Syntology official (archive's flag): 16 ran · 16 ran (of which 2 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 8 where Syntology's instrument failed) · 7 unverified (of 23 harvested samples) · 23 pointer-only (licence)These representations are typically explicit, such as 3D point clouds or meshes, and thus provide information in the direct surroundings of the intermediate hand pose estimate.
-
11 Oct 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)Specifically, for an initial hand-object pose estimated by a base network, we forward it to a physics simulator to evaluate its stability.
-
19 Jul 2023 1 repository listedThe surgical usage of Mixed Reality (MR) has received growing attention in areas such as surgical navigation systems, skill assessment, and robot-assisted surgeries.
-
24 Apr 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)In particular, we address reconstruction of hands and manipulated objects from monocular RGB images.
-
1 Jan 2023 1 repository listedNotably, the performance of our model on hand pose estimation even surpasses that of existing works that only perform the single-hand pose estimation task.
-
16 Nov 2022 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)In contrast, we propose a novel dense mutual attention mechanism that is able to model fine-grained dependencies between the hand and the object.
-
31 Oct 2022 1 repository listedWe propose a novel benchmark for object group distribution shifts in hand and object pose regression.
-
8 Oct 2022 1 repository listedWhen manipulating an object to accomplish complex tasks, humans rely on both vision and touch to keep track of the object's 6D pose.
-
16 Aug 2021 1 repository listedOur work aims to obtain 3D reconstruction of hands and manipulated objects from monocular videos.
-
9 Jun 2021 1 repository listedEstimating 3D hand and object pose from a single image is an extremely challenging problem: hands and objects are often self-occluded during interactions, and the 3D annotations are scarce as even humans cannot directly…
-
29 Apr 2021 1 repository listedWe propose a robust and accurate method for estimating the 3D poses of two hands in close interaction from a single color image.
-
31 Mar 2020 1 repository listedHand-object pose estimation (HOPE) aims to jointly detect the poses of both a hand and of a held object.
-
7 Mar 2020 1 repository listedThe hand's point cloud is pruned and robust global registration is performed to generate object pose hypotheses, which are clustered.
-
Occlusion-Aware 3D Hand-Object Pose Estimation with Masked AutoEncoders12 Jun 2025 0 repositories listedHand-object pose estimation from monocular RGB images remains a significant challenge mainly due to the severe occlusions inherent in hand-object interactions.
-
ViTa-Zero: Zero-shot Visuotactile Object 6D Pose Estimation17 Apr 2025 0 repositories listedObject 6D pose estimation is a critical challenge in robotics, particularly for manipulation tasks.
-
OccRobNet : Occlusion Robust Network for Accurate 3D Interacting Hand-Object Pose Estimation27 Mar 2025 0 repositories listedOcclusion is one of the challenging issues when estimating 3D hand pose.
-
Collaborative Learning for 3D Hand-Object Reconstruction and Compositional Action Recognition from Egocentric RGB Videos Using Superquadrics13 Jan 2025 0 repositories listedWith the availability of egocentric 3D hand-object interaction datasets, there is increasing interest in developing unified models for hand-object pose estimation and action recognition.
-
HOGSA: Bimanual Hand-Object Interaction Understanding with 3D Gaussian Splatting Based Data Augmentation6 Jan 2025 0 repositories listedUnderstanding of bimanual hand-object interaction plays an important role in robotics and virtual reality.
-
UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimation1 Jan 2025 0 repositories listedEstimating the 3D pose of hand and potential hand-held object from monocular images is a longstanding challenge.
-
NCRF: Neural Contact Radiance Fields for Free-Viewpoint Rendering of Hand-Object Interaction8 Feb 2024 0 repositories listedModeling hand-object interactions is a fundamentally challenging task in 3D computer vision.
-
ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation7 Sep 2023 0 repositories listedWe present ArtiGrasp, a novel method to synthesize bi-manual hand-object interactions that include grasping and articulation.
-
Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wild24 Sep 2022 0 repositories listedIn this work, we tackle the challenging task of jointly tracking hand object pose and reconstructing their shapes from depth point cloud sequences in the wild, given the initial poses at frame 0.
-
S²Contact: Graph-based Network for 3D Hand-Object Contact Estimation with Semi-Supervised Learning1 Aug 2022 0 repositories listedDespite the recent efforts in accurate 3D annotations in hand and object datasets, there still exist gaps in 3D hand and object reconstructions.
-
27 Apr 2022 0 repositories listedEstimating the pose and shape of hands and objects under interaction finds numerous applications including augmented and virtual reality.
-
28 Mar 2022 0 repositories listed Syntology 6 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)Hands are often severely occluded by objects, which makes 3D hand mesh estimation challenging.
-
Semi-supervised 3D Hand-Object Pose Estimation via Pose Dictionary Learning16 Jul 2021 0 repositories listed
-
22 Apr 2021 0 repositories listed
-
28 Apr 2020 0 repositories listed
-
Generalized Feedback Loop for Joint Hand-Object Pose Estimation25 Mar 2019 0 repositories listed
Syntology lines on 5 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections