Papers › ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration...

ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis

12 Sep 2021CVPR 2022 1arXiv:2109.05488archive 2025-07-28

Kailin Li, Lixin Yang, Xinyu Zhan, Jun Lv, Wenqiang Xu, Jiefeng Li, Cewu Lu

Estimating the articulated 3D hand-object pose from a single RGB image is a highly ambiguous and challenging problem, requiring large-scale datasets that contain diverse hand poses, object types, and camera viewpoints. Most real-world datasets lack these diversities. In contrast, data synthesis can easily ensure those diversities separately. However, constructing both valid and diverse hand-object interactions and efficiently learning from the vast synthetic data is still challenging. To address the above issues, we propose ArtiBoost, a lightweight online data enhancement method. ArtiBoost can cover diverse hand-object poses and camera viewpoints through sampling in a Composited hand-object Configuration and Viewpoint space (CCV-space) and can adaptively enrich the current hard-discernable items by loss-feedback and sample re-weighting. ArtiBoost alternatively performs data exploration and synthesis within a learning pipeline, and those synthetic data are blended into real-world source data for training. We apply ArtiBoost on a simple learning baseline network and witness the performance boost on several hand-object benchmarks. Our models and code are available at https://github.com/lixiny/ArtiBoost.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

lixiny/artiboost officialmentioned in papermentioned on GitHubjax report
mvig-sjtu/artiboost officialmentioned in papermentioned on GitHubjax report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Hand Pose EstimationObjectPose Estimationhand-object pose

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Hand Pose Estimation HO-3D v2 ArtiBoost AUC_J 0.773 #20 of 24 Archive leaderboard report
3D Hand Pose Estimation HO-3D v2 ArtiBoost AUC_V 0.782 #20 of 24 Archive leaderboard report
3D Hand Pose Estimation HO-3D v2 ArtiBoost F@15mm 0.944 #20 of 24 Archive leaderboard report
3D Hand Pose Estimation HO-3D v2 ArtiBoost F@5mm 0.488 #20 of 24 Archive leaderboard report
3D Hand Pose Estimation HO-3D v2 ArtiBoost PA-MPJPE (mm) 11.4 #20 of 24 Archive leaderboard report
3D Hand Pose Estimation HO-3D v2 ArtiBoost PA-MPVPE 10.9 #20 of 24 Archive leaderboard report
3D Hand Pose Estimation HO-3D v3 ArtiBoost AUC_J 0.785 #5 of 8 Archive leaderboard report
3D Hand Pose Estimation HO-3D v3 ArtiBoost AUC_V 0.792 #5 of 8 Archive leaderboard report
3D Hand Pose Estimation HO-3D v3 ArtiBoost F@15mm 0.946 #5 of 8 Archive leaderboard report
3D Hand Pose Estimation HO-3D v3 ArtiBoost F@5mm 0.507 #5 of 8 Archive leaderboard report
3D Hand Pose Estimation HO-3D v3 ArtiBoost PA-MPJPE 10.8 #5 of 8 Archive leaderboard report
3D Hand Pose Estimation HO-3D v3 ArtiBoost PA-MPVPE 10.4 #5 of 8 Archive leaderboard report
hand-object pose DexYCB ArtiBoost ADD-S - #4 of 9 Archive leaderboard report
hand-object pose DexYCB ArtiBoost Average MPJPE (mm) 12.8 #4 of 9 Archive leaderboard report
hand-object pose DexYCB ArtiBoost MCE - #4 of 9 Archive leaderboard report
hand-object pose DexYCB ArtiBoost OCE - #4 of 9 Archive leaderboard report
hand-object pose DexYCB ArtiBoost Procrustes-Aligned MPJPE - #4 of 9 Archive leaderboard report
hand-object pose HO-3D v2 ArtiBoost ADD-S - #3 of 9 Archive leaderboard report
hand-object pose HO-3D v2 ArtiBoost Average MPJPE (mm) 26.3 #3 of 9 Archive leaderboard report
hand-object pose HO-3D v2 ArtiBoost OME - #3 of 9 Archive leaderboard report
hand-object pose HO-3D v2 ArtiBoost PA-MPJPE 11.4 #3 of 9 Archive leaderboard report
hand-object pose HO-3D v2 ArtiBoost ST-MPJPE 25.3 #3 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections