{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hand-keypoint-detection-in-single-images","title":"Hand Keypoint Detection in Single Images using Multiview Bootstrapping","arxiv_id":"1704.07809","date":"2017-04-25","proceeding":"CVPR 2017 7","authors":["Tomas Simon","Hanbyul Joo","Iain Matthews","Yaser Sheikh"],"abstract":"We present an approach that uses a multi-camera system to train fine-grained\ndetectors for keypoints that are prone to occlusion, such as the joints of a\nhand. We call this procedure multiview bootstrapping: first, an initial\nkeypoint detector is used to produce noisy labels in multiple views of the\nhand. The noisy detections are then triangulated in 3D using multiview geometry\nor marked as outliers. Finally, the reprojected triangulations are used as new\nlabeled training data to improve the detector. We repeat this process,\ngenerating more labeled data in each iteration. We derive a result analytically\nrelating the minimum number of views to achieve target true and false positive\nrates for a given detector. The method is used to train a hand keypoint\ndetector for single images. The resulting keypoint detector runs in realtime on\nRGB images and has accuracy comparable to methods that use depth sensors. The\nsingle view detector, triangulated over multiple views, enables 3D markerless\nhand motion capture with complex object interactions.","url_abs":"http://arxiv.org/abs/1704.07809v1","url_pdf":"http://arxiv.org/pdf/1704.07809v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/CMU-Perceptual-Computing-Lab/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/D1vyansh/BodyJointDetection","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/Kaif10/Pose-Detection","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/KarinaKorsgaard/Bartender-AI-OpenPose-Osc-Sender","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/Kathik-R/Gesture_Recognition_Drone","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/blake58/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/chengguixiong1010/rnn_STAF_2dpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/erezposner/HandKeyPointDetector","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/fcr3/OpenVINO_Tutorials","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/fcr3/wine_detector","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/fengyidong123/openpose-master","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/harshalsonioo1/hpe","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/inzva/hand-joint-detection","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/jarrodanderson/openpose-demo","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/jreisam/Unity-OpenPose-Edutable","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/laobaiswag/openpose1","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/liang-faan/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/lncarter/Openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/lwxGitHub123/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/lwxGitHub123/openpose20200610","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/mgolnezhad/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/mohammadreyaz/openposered","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/mohammadreyaz/pose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/oublalkhalid/AI-OpenPose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/qdhill/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/radioactiverockets/OpenPoseBreackoutGame","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/soulslicer/staf","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/starman360/openpose_xavier","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/techforgood-kiran/ai","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/theyellowdiary/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/xaoch/rapJetson2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/xar47x/pose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/xiaozeguo123/-Quick-Capture-system-HSR","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/yikegami/openpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/yinzhiyan43/openpose-dev","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/yongsheng268/OpenPose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/zyxcambridge/openpose_all","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"hand-keypoint-detection-in-single-images","repo_url":"https://github.com/open-mmlab/mmpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"keypoint-detection","task_name":"Keypoint Detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1704.07809","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}