Papers › Expressive Body Capture: 3D Hands, Face, and Body from a Single Image

Expressive Body Capture: 3D Hands, Face, and Body from a Single Image

11 Apr 2019CVPR 2019 6arXiv:1904.05866archive 2025-07-28

Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, Michael J. Black

To facilitate the analysis of human actions, interactions and emotions, we compute a 3D model of human body pose, hand pose, and facial expression from a single monocular image. To achieve this, we use thousands of 3D scans to train a new, unified, 3D model of the human body, SMPL-X, that extends SMPL with fully articulated hands and an expressive face. Learning to regress the parameters of SMPL-X directly from images is challenging without paired images and 3D ground truth. Consequently, we follow the approach of SMPLify, which estimates 2D features and then optimizes model parameters to fit the features. We improve on SMPLify in several significant ways: (1) we detect 2D features corresponding to the face, hands, and feet and fit the full SMPL-X model to these; (2) we train a new neural network pose prior using a large MoCap dataset; (3) we define a new interpenetration penalty that is both fast and accurate; (4) we automatically detect gender and the appropriate body models (male, female, or neutral); (5) our PyTorch implementation achieves a speedup of more than 8x over Chumpy. We use the new method, SMPLify-X, to fit SMPL-X to both controlled images and images in the wild. We evaluate 3D accuracy on a new curated dataset comprising 100 images with pseudo ground-truth. This is a step towards automatic expressive human capture from monocular RGB data. The models, code, and data are available for research purposes at https://smpl-x.is.tue.mpg.de.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

vchoutas/smplify-x officialpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human Pose Estimation3D Human Reconstruction3D Multi-Person Mesh Recovery3D Reconstruction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Reconstruction AGORA SMPLify-X B-MPJPE 182.1 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X B-MVE 187.0 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X B-NMJE 256.5 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X B-NMVE 263.3 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X F-MPJPE 52.9 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X F-MVE 48.9 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X FB-MPJPE 231.8 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X FB-MVE 236.5 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X FB-NMJE 326.5 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X FB-NMVE 333.1 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X LH/RH-MPJPE 46.5/49.6 #4 of 5 Archive leaderboard report
3D Human Reconstruction AGORA SMPLify-X LH/RH-MVE 48.3/51.4 #4 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X MPJPE, left hand 12.2 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X MPJPE-14 87.6 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X PA V2V (mm), body only 75.4 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X PA V2V (mm), face 4.9 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X PA V2V (mm), left hand 11.6 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X TR V2V (mm), body only 116.1 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X TR V2V (mm), face 11.5 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X TR V2V (mm), left hand 23.8 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X TR V2V (mm), whole body 93.0 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X mean P2S 36.8 #5 of 5 Archive leaderboard report
3D Human Reconstruction Expressive hands and faces dataset (EHF) SMPLify-X median P2S 23.0 #5 of 5 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X B-MPJPE 182.1 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X B-MVE 187.0 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X B-NMJE 256.5 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X B-NMVE 263.3 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X F-MPJPE 52.9 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X F-MVE 48.9 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X FB-MPJPE 231.8 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X FB-MVE 236.5 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X FB-NMJE 326.5 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X FB-NMVE 333.1 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X LH/RH-MPJPE 46.5/49.6 #7 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLify-X LH/RH-MVE 48.3/51.4 #7 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections