{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/shpr-net-deep-semantic-hand-pose-regression","title":"SHPR-Net: Deep Semantic Hand Pose Regression From Point Clouds","arxiv_id":null,"date":"2018-08-06","proceeding":"IEEE Access 2018 8","authors":["Xinghao Chen","Guijin Wang","Cairong Zhang","Tae-Kyun Kim","Xiangyang Ji"],"abstract":"3D hand pose estimation is an essential problem for human computer interaction. Most of the existing depth-based hand pose estimation methods consume 2D depth map or 3D volume via 2D/3D convolutional neural networks (CNNs). In this paper, we propose a deep Semantic Hand Pose Regression network (SHPR-Net) for hand pose estimation from point sets, which consists of two subnetworks: a semantic segmentation subnetwork and a hand pose regression subnetwork. The semantic segmentation network assigns semantic labels for each point in the point set. The pose regression network integrates the semantic priors with both input and late fusion strategy and regresses the final hand pose. Two transformation matrices are learned from the point set and applied to transform the input point cloud and inversely transform the output pose respectively, which makes the SHPR-Net more robust to geometric transformations. Experiments on NYU, ICVL and MSRA hand pose datasets demonstrate that our SHPRNet achieves high performance on par with start-of-the-art methods. We also show that our method can be naturally extended to hand pose estimation from multi-view depth data and achieves further improvement on NYU dataset.","url_abs":"https://ieeexplore.ieee.org/document/8425735/","url_pdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8425735&tag=1","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"3d-hand-pose-estimation","task_name":"3D Hand Pose Estimation"},{"task_slug":"hand-pose-estimation","task_name":"Hand Pose Estimation"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/hand-pose-estimation-on-icvl-hands","task":"Hand Pose Estimation","dataset":"ICVL Hands","model":"SHPR-Net","rank_in_archive_order":11,"of":15,"metrics":{"Average 3D Error":"7.22"},"uses_additional_data":false},{"leaderboard":"/sota/hand-pose-estimation-on-msra-hands","task":"Hand Pose Estimation","dataset":"MSRA Hands","model":"SHPR-Net","rank_in_archive_order":7,"of":11,"metrics":{"Average 3D Error":"7.76"},"uses_additional_data":false},{"leaderboard":"/sota/hand-pose-estimation-on-nyu-hands","task":"Hand Pose Estimation","dataset":"NYU Hands","model":"SHPR-Net","rank_in_archive_order":12,"of":17,"metrics":{"Average 3D Error":"9.37"},"uses_additional_data":true}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}