Papers › Kinematic-aware Hierarchical Attention Network for Human Pose Estimation in Videos

Kinematic-aware Hierarchical Attention Network for Human Pose Estimation in Videos

29 Nov 2022arXiv:2211.15868archive 2025-07-28

Kyung-Min Jin, Byoung-Sung Lim, Gun-Hee Lee, Tae-Kyung Kang, Seong-Whan Lee

Previous video-based human pose estimation methods have shown promising results by leveraging aggregated features of consecutive frames. However, most approaches compromise accuracy to mitigate jitter or do not sufficiently comprehend the temporal aspects of human motion. Furthermore, occlusion increases uncertainty between consecutive frames, which results in unsmooth results. To address these issues, we design an architecture that exploits the keypoint kinematic features with the following components. First, we effectively capture the temporal features by leveraging individual keypoint's velocity and acceleration. Second, the proposed hierarchical transformer encoder aggregates spatio-temporal dependencies and refines the 2D or 3D input pose estimated from existing estimators. Finally, we provide an online cross-supervision between the refined input pose generated from the encoder and the final pose from our decoder to enable joint optimization. We demonstrate comprehensive results and validate the effectiveness of our model in various tasks: 2D pose estimation, 3D pose estimation, body mesh recovery, and sparsely annotated multi-human pose estimation. Our code is available at https://github.com/KyungMinJin/HANet.

PaperPDFCode

Code

kyungminjin/hanet officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

2D Pose Estimation3D Human Pose Estimation3D Pose EstimationDecoderPose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Pose Estimation 3DPW PARE + HANet (T=51) Acceleration Error 8 #115 of 119 Archive leaderboard report
3D Human Pose Estimation 3DPW PARE + HANet (T=51) MPJPE 74.6 #115 of 119 Archive leaderboard report
3D Human Pose Estimation 3DPW PARE + HANet (T=101) Acceleration Error 6.8 #117 of 119 Archive leaderboard report
3D Human Pose Estimation 3DPW PARE + HANet (T=101) MPJPE 77.1 #117 of 119 Archive leaderboard report
3D Human Pose Estimation AIST++ SPIN + HANet (T=51) Acceleration Error 6.4 #3 of 5 Archive leaderboard report
3D Human Pose Estimation AIST++ SPIN + HANet (T=51) MPJPE 64.3 #3 of 5 Archive leaderboard report
3D Human Pose Estimation AIST++ SPIN + HANet (T=101) Acceleration Error 5.4 #5 of 5 Archive leaderboard report
3D Human Pose Estimation AIST++ SPIN + HANet (T=101) MPJPE 69.2 #5 of 5 Archive leaderboard report
Pose Estimation J-HMDB SimpleBaseline + HANet Mean PCK@0.05 91.9 #1 of 5 Archive leaderboard report
Pose Estimation J-HMDB SimpleBaseline + HANet Mean PCK@0.1 98.3 #1 of 5 Archive leaderboard report
Pose Estimation J-HMDB SimpleBaseline + HANet Mean PCK@0.2 99.6 #1 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections