Papers › PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation

PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation

6 May 2021CVPR 2021 1arXiv:2105.02465archive 2025-07-28

Kehong Gong, Jianfeng Zhang, Jiashi Feng

Existing 3D human pose estimators suffer poor generalization performance to new datasets, largely due to the limited diversity of 2D-3D pose pairs in the training data. To address this problem, we present PoseAug, a new auto-augmentation framework that learns to augment the available training poses towards a greater diversity and thus improve generalization of the trained 2D-to-3D pose estimator. Specifically, PoseAug introduces a novel pose augmentor that learns to adjust various geometry factors (e.g., posture, body size, view point and position) of a pose through differentiable operations. With such differentiable capacity, the augmentor can be jointly optimized with the 3D pose estimator and take the estimation error as feedback to generate more diverse and harder poses in an online manner. Moreover, PoseAug introduces a novel part-aware Kinematic Chain Space for evaluating local joint-angle plausibility and develops a discriminative module accordingly to ensure the plausibility of the augmented poses. These elaborate designs enable PoseAug to generate more diverse yet plausible poses than existing offline augmentation methods, and thus yield better generalization of the pose estimator. PoseAug is generic and easy to be applied to various 3D pose estimators. Extensive experiments demonstrate that PoseAug brings clear improvements on both intra-scenario and cross-scenario datasets. Notably, it achieves 88.6% 3D PCK on MPI-INF-3DHP under cross-dataset evaluation setup, improving upon the previous best data augmentation based method by 9.1%. Code can be found at: https://github.com/jfzhang95/PoseAug.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

jfzhang95/PoseAug officialmentioned in papermentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human Pose EstimationData AugmentationDiversityMonocular 3D Human Pose EstimationPose EstimationWeakly-supervised 3D Human Pose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Pose Estimation 3DPW HR-Net+ST-GCN+PoseAug PA-MPJPE 73.2 #107 of 119 Archive leaderboard report
3D Human Pose Estimation Human3.6M HR-Net+VPose+PoseAug Average MPJPE (mm) 50.2 #64 of 88 Archive leaderboard report
3D Human Pose Estimation Human3.6M HR-Net+VPose+PoseAug Multi-View or Monocular Monocular #64 of 88 Archive leaderboard report
3D Human Pose Estimation Human3.6M HR-Net+VPose+PoseAug Using 2D ground-truth joints No #64 of 88 Archive leaderboard report
3D Human Pose Estimation Human3.6M HR-Net+ST-GCN+PoseAug Average MPJPE (mm) 50.8 #69 of 88 Archive leaderboard report
3D Human Pose Estimation Human3.6M HR-Net+ST-GCN+PoseAug Multi-View or Monocular Monocular #69 of 88 Archive leaderboard report
3D Human Pose Estimation Human3.6M HR-Net+ST-GCN+PoseAug Using 2D ground-truth joints No #69 of 88 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP PoseAug (+Extra2D) AUC 57.9 #29 of 108 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP PoseAug (+Extra2D) MPJPE 71.1 #29 of 108 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP PoseAug (+Extra2D) PCK 89.2 #29 of 108 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP VPose+PoseAug AUC 57.3 #31 of 108 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP VPose+PoseAug MPJPE 73 #31 of 108 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP VPose+PoseAug PCK 88.6 #31 of 108 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP HR-Net+VPose+PoseAug MPJPE 73.2 #32 of 108 Archive leaderboard report
3D Human Pose Estimation MPI-INF-3DHP HR-Net+ST-GCN+PoseAug MPJPE 76.6 #35 of 108 Archive leaderboard report
Monocular 3D Human Pose Estimation Human3.6M HR-Net+VPose+PoseAug Average MPJPE (mm) 50.2 #23 of 52 Archive leaderboard report
Monocular 3D Human Pose Estimation Human3.6M HR-Net+VPose+PoseAug PA-MPJPE 39.1 #23 of 52 Archive leaderboard report
Monocular 3D Human Pose Estimation Human3.6M PoseAug Frames Needed 1 #47 of 52 Archive leaderboard report
Monocular 3D Human Pose Estimation Human3.6M PoseAug Need Ground Truth 2D Pose No #47 of 52 Archive leaderboard report
Monocular 3D Human Pose Estimation Human3.6M PoseAug Use Video Sequence No #47 of 52 Archive leaderboard report
Weakly-supervised 3D Human Pose Estimation Human3.6M PoseAug 3D Annotations S1 #7 of 33 Archive leaderboard report
Weakly-supervised 3D Human Pose Estimation Human3.6M PoseAug Average MPJPE (mm) 56.7 #7 of 33 Archive leaderboard report
Weakly-supervised 3D Human Pose Estimation Human3.6M PoseAug Number of Frames Per View 1 #7 of 33 Archive leaderboard report
Weakly-supervised 3D Human Pose Estimation Human3.6M PoseAug Number of Views 1 #7 of 33 Archive leaderboard report
Weakly-supervised 3D Human Pose Estimation Human3.6M PoseAug 3D Annotations S1 #31 of 33 Archive leaderboard report
Weakly-supervised 3D Human Pose Estimation Human3.6M PoseAug Number of Frames Per View 1 #31 of 33 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections