Papers › Hand Keypoint Detection in Single Images using Multiview Bootstrapping

Hand Keypoint Detection in Single Images using Multiview Bootstrapping

25 Apr 2017CVPR 2017 7arXiv:1704.07809archive 2025-07-28

Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh

We present an approach that uses a multi-camera system to train fine-grained detectors for keypoints that are prone to occlusion, such as the joints of a hand. We call this procedure multiview bootstrapping: first, an initial keypoint detector is used to produce noisy labels in multiple views of the hand. The noisy detections are then triangulated in 3D using multiview geometry or marked as outliers. Finally, the reprojected triangulations are used as new labeled training data to improve the detector. We repeat this process, generating more labeled data in each iteration. We derive a result analytically relating the minimum number of views to achieve target true and false positive rates for a given detector. The method is used to train a hand keypoint detector for single images. The resulting keypoint detector runs in realtime on RGB images and has accuracy comparable to methods that use depth sensors. The single view detector, triangulated over multiple views, enables 3D markerless hand motion capture with complex object interactions.

PaperPDFConference PDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

39 repositories listed; official and paper-mentioned ones first.

CMU-Perceptual-Computing-Lab/openpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
CMU-Perceptual-Computing-Lab/openpose_unity_plugin mentioned on GitHubNOASSERTIONSyntology: not harvested report
D1vyansh/BodyJointDetection mentioned on GitHubpytorchSyntology: not harvested report
Kaif10/Pose-Detection mentioned on GitHubSyntology: not harvested report
KarinaKorsgaard/Bartender-AI-OpenPose-Osc-Sender mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
Kathik-R/Gesture_Recognition_Drone mentioned on GitHubSyntology: not harvested report
blake58/openpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
chengguixiong1010/rnn_STAF_2dpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
erezposner/HandKeyPointDetector mentioned on GitHubSyntology: not harvested report
fcr3/OpenVINO_Tutorials mentioned on GitHubtfSyntology: not harvested report
fcr3/wine_detector mentioned on GitHubtfSyntology: not harvested report
fengyidong123/openpose-master mentioned on GitHubpytorchSyntology: not harvested report
harshalsonioo1/hpe mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
inzva/hand-joint-detection mentioned on GitHubtfSyntology: not harvested report
jarrodanderson/openpose-demo mentioned on GitHubpytorchSyntology: not harvested report
jreisam/Unity-OpenPose-Edutable mentioned on GitHubNOASSERTIONSyntology: not harvested report
laobaiswag/openpose1 mentioned on GitHubpytorchSyntology: not harvested report
liang-faan/openpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
lncarter/Openpose mentioned on GitHubpytorchSyntology: not harvested report
lwxGitHub123/openpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
lwxGitHub123/openpose20200610 mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
mgolnezhad/openpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
mohammadreyaz/openposered mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
mohammadreyaz/pose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
oublalkhalid/AI-OpenPose mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
qdhill/openpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
radioactiverockets/OpenPoseBreackoutGame mentioned on GitHubNOASSERTIONSyntology: not harvested report
soulslicer/staf mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
starman360/openpose_xavier mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
techforgood-kiran/ai mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
theyellowdiary/openpose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
xaoch/rapJetson2 mentioned on GitHubpytorchSyntology: not harvested report
xar47x/pose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
xiaozeguo123/-Quick-Capture-system-HSR mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
yikegami/openpose mentioned on GitHubpytorchSyntology: not harvested report
yinzhiyan43/openpose-dev mentioned on GitHubpytorchSyntology: not harvested report
yongsheng268/OpenPose mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
zyxcambridge/openpose_all mentioned on GitHubpytorchSyntology: not harvested report
open-mmlab/mmpose pytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation (arXiv:2312.07526; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Keypoint Detection

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections