Papers › Rethinking Keypoint Representations: Modeling Keypoints and Poses as Objects for...

Rethinking Keypoint Representations: Modeling Keypoints and Poses as Objects for Multi-Person Human Pose Estimation

16 Nov 2021arXiv:2111.08557archive 2025-07-28

William McNally, Kanav Vats, Alexander Wong, John McPhee

In keypoint estimation tasks such as human pose estimation, heatmap-based regression is the dominant approach despite possessing notable drawbacks: heatmaps intrinsically suffer from quantization error and require excessive computation to generate and post-process. Motivated to find a more efficient solution, we propose to model individual keypoints and sets of spatially related keypoints (i.e., poses) as objects within a dense single-stage anchor-based detection framework. Hence, we call our method KAPAO (pronounced "Ka-Pow"), for Keypoints And Poses As Objects. KAPAO is applied to the problem of single-stage multi-person human pose estimation by simultaneously detecting human pose and keypoint objects and fusing the detections to exploit the strengths of both object representations. In experiments, we observe that KAPAO is faster and more accurate than previous methods, which suffer greatly from heatmap post-processing. The accuracy-speed trade-off is especially favourable in the practical setting when not using test-time augmentation. Source code: https://github.com/wmcnally/kapao.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

wmcnally/kapao officialmentioned in papermentioned on GitHubpytorchGPL-3.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Keypoint EstimationPose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Pose Estimation COCO test-dev KAPAO-L AP 70.3 #32 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-L AP50 91.2 #32 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-L AP75 77.8 #32 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-L APL 76.8 #32 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-L APM 66.3 #32 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-L AR 77.7 #32 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-M AP 68.8 #35 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-M AP50 90.5 #35 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-M AP75 76.5 #35 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-M APL 76 #35 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-M APM 64.3 #35 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-M AR 76.3 #35 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-S AP 63.8 #41 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-S AP50 88.4 #41 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-S AP75 70.4 #41 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-S APL 71.7 #41 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-S APM 58.6 #41 of 47 Archive leaderboard report
Pose Estimation COCO test-dev KAPAO-S AR 71.2 #41 of 47 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-L AP 68.9 #9 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-L AP50 89.4 #9 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-L AP75 75.6 #9 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-L APM 69.9 #9 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-L Test 76.6 #9 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-M AP 67.1 #10 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-M AP50 88.8 #10 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-M AP75 73.4 #10 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-M APM 68.1 #10 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-M Test 75.2 #10 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-S AP 63.8 #12 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-S AP50 87.7 #12 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-S AP75 69.4 #12 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-S APM 64.8 #12 of 12 Archive leaderboard report
Pose Estimation CrowdPose KAPAO-S Test 72.1 #12 of 12 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections