Papers › Towards Accurate Multi-person Pose Estimation in the Wild

Towards Accurate Multi-person Pose Estimation in the Wild

6 Jan 2017CVPR 2017 7arXiv:1701.01779archive 2025-07-28

George Papandreou, Tyler Zhu, Nori Kanazawa, Alexander Toshev, Jonathan Tompson, Chris Bregler, Kevin Murphy

We propose a method for multi-person detection and 2-D pose estimation that achieves state-of-art results on the challenging COCO keypoints task. It is a simple, yet powerful, top-down approach consisting of two stages. In the first stage, we predict the location and scale of boxes which are likely to contain people; for this we use the Faster RCNN detector. In the second stage, we estimate the keypoints of the person potentially contained in each proposed bounding box. For each keypoint type we predict dense heatmaps and offsets using a fully convolutional ResNet. To combine these outputs we introduce a novel aggregation procedure to obtain highly localized keypoint predictions. We also use a novel form of keypoint-based Non-Maximum-Suppression (NMS), instead of the cruder box-level NMS, and a novel form of keypoint-based confidence score estimation, instead of box-level scoring. Trained on COCO data alone, our final system achieves average precision of 0.649 on the COCO test-dev set and the 0.643 test-standard sets, outperforming the winner of the 2016 COCO keypoints challenge and other recent state-of-art. Further, by using additional in-house labeled data we obtain an even higher average precision of 0.685 on the test-dev set and 0.673 on the test-standard set, more than 5% absolute improvement compared to the previous best performing method on the same dataset.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Human DetectionKeypoint DetectionMulti-Person Pose EstimationPose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Keypoint Detection COCO test-challenge G-RMI* AP 69.1 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* AP50 85.9 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* AP75 75.2 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* APL 82.4 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* AR 75.1 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* AR50 90.7 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* AR75 80.7 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* ARL 74.5 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-challenge G-RMI* ARM 69.7 #6 of 8 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI AP50 85.5 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI AP75 71.3 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI APL 70.0 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI APM 62.3 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI AR 69.7 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI AR50 88.7 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI AR75 75.5 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI ARL 77.1 #11 of 16 Archive leaderboard report
Keypoint Detection COCO test-dev G-RMI ARM 64.4 #11 of 16 Archive leaderboard report
Multi-Person Pose Estimation COCO (Common Objects in Context) G-RMI* AP 0.685 #9 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO (Common Objects in Context) G-RMI AP 0.649 #12 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev G-RMI AP 64.9 #13 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev G-RMI AP50 85.5 #13 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev G-RMI AP75 71.3 #13 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev G-RMI APL 70.0 #13 of 15 Archive leaderboard report
Multi-Person Pose Estimation COCO test-dev G-RMI APM 62.3 #13 of 15 Archive leaderboard report
Pose Estimation COCO test-dev G-RMI AP 64.9 #38 of 47 Archive leaderboard report
Pose Estimation COCO test-dev G-RMI AP50 85.5 #38 of 47 Archive leaderboard report
Pose Estimation COCO test-dev G-RMI AP75 71.3 #38 of 47 Archive leaderboard report
Pose Estimation COCO test-dev G-RMI APL 70.0 #38 of 47 Archive leaderboard report
Pose Estimation COCO test-dev G-RMI AR 69.7 #38 of 47 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConvolutionGlobal Average PoolingKaiming InitializationMax PoolingReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections