Papers › Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinement

Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinement

24 Oct 2022arXiv:2210.13529archive 2025-07-28

Junuk Cha, Muhammad Saqlain, GeonU Kim, Mingyu Shin, Seungryul Baek

Estimating 3D poses and shapes in the form of meshes from monocular RGB images is challenging. Obviously, it is more difficult than estimating 3D poses only in the form of skeletons or heatmaps. When interacting persons are involved, the 3D mesh reconstruction becomes more challenging due to the ambiguity introduced by person-to-person occlusions. To tackle the challenges, we propose a coarse-to-fine pipeline that benefits from 1) inverse kinematics from the occlusion-robust 3D skeleton estimation and 2) Transformer-based relation-aware refinement techniques. In our pipeline, we first obtain occlusion-robust 3D skeletons for multiple persons from an RGB image. Then, we apply inverse kinematics to convert the estimated skeletons to deformable 3D mesh parameters. Finally, we apply the Transformer-based mesh refinement that refines the obtained mesh parameters considering intra- and inter-person relations of 3D meshes. Via extensive experiments, we demonstrate the effectiveness of our method, outperforming state-of-the-arts on 3DPW, MuPoTS and AGORA datasets.

PaperPDFCode

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

JunukCha/MultiPerson officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human Pose Estimation3D Multi-Person Pose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Pose Estimation AGORA Multi-Person 3D Pose and Shape Estimationvia Inverse Kinematics and Refinement B-MPJPE 91.6 #7 of 11 Archive leaderboard report
3D Human Pose Estimation AGORA Multi-Person 3D Pose and Shape Estimationvia Inverse Kinematics and Refinement B-MVE 86.7 #7 of 11 Archive leaderboard report
3D Human Pose Estimation AGORA Multi-Person 3D Pose and Shape Estimationvia Inverse Kinematics and Refinement B-NMJE 110.4 #7 of 11 Archive leaderboard report
3D Human Pose Estimation AGORA Multi-Person 3D Pose and Shape Estimationvia Inverse Kinematics and Refinement B-NMVE 104.5 #7 of 11 Archive leaderboard report
3D Multi-Person Pose Estimation MuPoTS-3D Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinement 3DPCK 89.9 #1 of 10 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections