Papers › Self-Constrained Inference Optimization on Structural Groups for Human Pose Estimation

Self-Constrained Inference Optimization on Structural Groups for Human Pose Estimation

6 Jul 2022arXiv:2207.02425archive 2025-07-28

Zhehan Kan, Shuoshuo Chen, Zeng Li, Zhihai He

We observe that human poses exhibit strong group-wise structural correlation and spatial coupling between keypoints due to the biological constraints of different body parts. This group-wise structural correlation can be explored to improve the accuracy and robustness of human pose estimation. In this work, we develop a self-constrained prediction-verification network to characterize and learn the structural correlation between keypoints during training. During the inference stage, the feedback information from the verification network allows us to perform further optimization of pose prediction, which significantly improves the performance of human pose estimation. Specifically, we partition the keypoints into groups according to the biological structure of human body. Within each group, the keypoints are further partitioned into two subsets, high-confidence base keypoints and low-confidence terminal keypoints. We develop a self-constrained prediction-verification network to perform forward and backward predictions between these keypoint subsets. One fundamental challenge in pose estimation, as well as in generic prediction tasks, is that there is no mechanism for us to verify if the obtained pose estimation or prediction results are accurate or not, since the ground truth is not available. Once successfully learned, the verification network serves as an accuracy verification module for the forward pose prediction. During the inference stage, it can be used to guide the local optimization of the pose estimation results of low-confidence keypoints with the self-constrained loss on high-confidence keypoints as the objective function. Our extensive experimental results on benchmark MS COCO and CrowdPose datasets demonstrate that the proposed method can significantly improve the pose estimation results.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Inference OptimizationMulti-Person Pose EstimationPose EstimationPose PredictionPrediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multi-Person Pose Estimation COCO test-dev SCIO (HRNet-48) AP 79.2 #1 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev SCIO (HRNet-48) AP50 93.5 #1 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev SCIO (HRNet-48) AP75 85.8 #1 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev SCIO (HRNet-48) APL 84.2 #1 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev SCIO (HRNet-48) APM 74.1 #1 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev SCIO (HRNet-48) AR 81.6 #1 of 15 Archive leaderboard report
Multi-Person Pose Estimation CrowdPose SCIO (HRNet-48) AP Medium 72.2 #11 of 28 Archive leaderboard report
Multi-Person Pose Estimation CrowdPose SCIO (HRNet-48) mAP @0.5:0.95 71.5 #11 of 28 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

BASE

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections