Papers › TFPose: Direct Human Pose Estimation with Transformers

TFPose: Direct Human Pose Estimation with Transformers

29 Mar 2021arXiv:2103.15320archive 2025-07-28

Weian Mao, Yongtao Ge, Chunhua Shen, Zhi Tian, Xinlong Wang, Zhibin Wang

We propose a human pose estimation framework that solves the task in the regression-based fashion. Unlike previous regression-based methods, which often fall behind those state-of-the-art methods, we formulate the pose estimation task into a sequence prediction problem that can effectively be solved by transformers. Our framework is simple and direct, bypassing the drawbacks of the heatmap-based pose estimation. Moreover, with the attention mechanism in transformers, our proposed framework is able to adaptively attend to the features most relevant to the target keypoints, which largely overcomes the feature misalignment issue of previous regression-based methods and considerably improves the performance. Importantly, our framework can inherently take advantages of the structured relationship between keypoints. Experiments on the MS-COCO and MPII datasets demonstrate that our method can significantly improve the state-of-the-art of regression-based pose estimation and perform comparably with the best heatmap-based pose estimation methods.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Pose Estimationregression

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Pose Estimation COCO test-dev TFPose (ND=6 ResNet-50) AP 72.2 #28 of 47 Archive leaderboard report
Pose Estimation COCO test-dev TFPose (ND=6 ResNet-50) AP50 90.9 #28 of 47 Archive leaderboard report
Pose Estimation COCO test-dev TFPose (ND=6 ResNet-50) AP75 80.1 #28 of 47 Archive leaderboard report
Pose Estimation COCO test-dev TFPose (ND=6 ResNet-50) APL 78.8 #28 of 47 Archive leaderboard report
Pose Estimation COCO test-dev TFPose (ND=6 ResNet-50) APM 69.1 #28 of 47 Archive leaderboard report
Pose Estimation MPII Human Pose TFPose(ResNet-50) PCKh-0.5 90.4 #26 of 46 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections