Papers › Semantics-aware Test-time Adaptation for 3D Human Pose Estimation

Semantics-aware Test-time Adaptation for 3D Human Pose Estimation

15 Feb 2025arXiv:2502.10724archive 2025-07-28

Qiuxia Lin, Rongyu Chen, Kerui Gu, Angela Yao

This work highlights a semantics misalignment in 3D human pose estimation. For the task of test-time adaptation, the misalignment manifests as overly smoothed and unguided predictions. The smoothing settles predictions towards some average pose. Furthermore, when there are occlusions or truncations, the adaptation becomes fully unguided. To this end, we pioneer the integration of a semantics-aware motion prior for the test-time adaptation of 3D pose estimation. We leverage video understanding and a well-structured motion-text space to adapt the model motion prediction to adhere to video semantics during test time. Additionally, we incorporate a missing 2D pose completion based on the motion-text similarity. The pose completion strengthens the motion prior's guidance for occlusions and truncations. Our method significantly improves state-of-the-art 3D human pose estimation TTA techniques, with more than 12% decrease in PA-MPJPE on 3DPW and 3DHP.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human Pose Estimation3D Pose Estimation3D human pose and shape estimationPose EstimationTest-time AdaptationVideo Understandingmotion predictiontext similarity

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D human pose and shape estimation EgoBody SemanticsTTA (HMR2.0) Average MPJPE (mm) 104.6 #2 of 2 Archive leaderboard report
3D human pose and shape estimation EgoBody SemanticsTTA (HMR2.0) PA-MPJPE 56.1 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections