Papers › SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation

SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation

29 Sep 2023NeurIPS 2023 11arXiv:2309.17448archive 2025-07-28

Zhongang Cai, Wanqi Yin, Ailing Zeng, Chen Wei, Qingping Sun, Yanjun Wang, Hui En Pang, Haiyi Mei, Mingyuan Zhang, Lei Zhang, Chen Change Loy, Lei Yang, Ziwei Liu

Expressive human pose and shape estimation (EHPS) unifies body, hands, and face motion capture with numerous applications. Despite encouraging progress, current state-of-the-art methods still depend largely on a confined set of training datasets. In this work, we investigate scaling up EHPS towards the first generalist foundation model (dubbed SMPLer-X), with up to ViT-Huge as the backbone and training with up to 4.5M instances from diverse data sources. With big data and the large model, SMPLer-X exhibits strong performance across diverse test benchmarks and excellent transferability to even unseen environments. 1) For the data scaling, we perform a systematic investigation on 32 EHPS datasets, including a wide range of scenarios that a model trained on any single dataset cannot handle. More importantly, capitalizing on insights obtained from the extensive benchmarking process, we optimize our training scheme and select datasets that lead to a significant leap in EHPS capabilities. 2) For the model scaling, we take advantage of vision transformers to study the scaling law of model sizes in EHPS. Moreover, our finetuning strategy turn SMPLer-X into specialist models, allowing them to achieve further performance boosts. Notably, our foundation model SMPLer-X consistently delivers state-of-the-art results on seven benchmarks such as AGORA (107.2 mm NMVE), UBody (57.4 mm PVE), EgoBody (63.6 mm PVE), and EHF (62.3 mm PVE without finetuning). Homepage: https://caizhongang.github.io/projects/SMPLer-X/

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

caizhongang/SMPLer-X officialmentioned on GitHubpytorchNOASSERTION report
wqyin/smplest-x mentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human Pose Estimation3D Human Reconstruction3D Multi-Person Mesh RecoveryBenchmarking

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Pose Estimation 3DPW SMPLer-X MPJPE 75.2 #116 of 119 Archive leaderboard report
3D Human Pose Estimation UBody SMPLer-X PA-PVE-All 31.9 #2 of 4 Archive leaderboard report
3D Human Pose Estimation UBody SMPLer-X PA-PVE-Face 2.8 #2 of 4 Archive leaderboard report
3D Human Pose Estimation UBody SMPLer-X PA-PVE-Hands 10.3 #2 of 4 Archive leaderboard report
3D Human Pose Estimation UBody SMPLer-X PVE-All 57.5 #2 of 4 Archive leaderboard report
3D Human Pose Estimation UBody SMPLer-X PVE-Face 21.6 #2 of 4 Archive leaderboard report
3D Human Pose Estimation UBody SMPLer-X PVE-Hands 40.2 #2 of 4 Archive leaderboard report
3D Human Reconstruction EHF SMPLer-X MPVPE 62.4 #2 of 3 Archive leaderboard report
3D Human Reconstruction EHF SMPLer-X PA V2V (mm), whole body 37.1 #2 of 3 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLer-X B-NMVE 68.3 #3 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLer-X F-MVE 29.9 #3 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLer-X FB-MVE 99.7 #3 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLer-X FB-NMVE 107.2 #3 of 7 Archive leaderboard report
3D Multi-Person Mesh Recovery AGORA SMPLer-X LH/RH-MVE 39.3 #3 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections