Papers › ECON: Explicit Clothed humans Optimized via Normal integration

ECON: Explicit Clothed humans Optimized via Normal integration

14 Dec 2022CVPR 2023 1arXiv:2212.07422archive 2025-07-28

Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black

The combination of deep learning, artist-curated scans, and Implicit Functions (IF), is enabling the creation of detailed, clothed, 3D humans from images. However, existing methods are far from perfect. IF-based methods recover free-form geometry, but produce disembodied limbs or degenerate shapes for novel poses or clothes. To increase robustness for these cases, existing work uses an explicit parametric body model to constrain surface reconstruction, but this limits the recovery of free-form surfaces such as loose clothing that deviates from the body. What we want is a method that combines the best properties of implicit representation and explicit body regularization. To this end, we make two key observations: (1) current networks are better at inferring detailed 2D maps than full-3D surfaces, and (2) a parametric model can be seen as a "canvas" for stitching together detailed surface patches. Based on these, our method, ECON, has three main steps: (1) It infers detailed 2D normal maps for the front and back side of a clothed person. (2) From these, it recovers 2.5D front and back surfaces, called d-BiNI, that are equally detailed, yet incomplete, and registers these w.r.t. each other with the help of a SMPL-X body mesh recovered from the image. (3) It "inpaints" the missing geometry between d-BiNI surfaces. If the face and hands are noisy, they can optionally be replaced with the ones of SMPL-X. As a result, ECON infers high-fidelity 3D humans even in loose clothes and challenging poses. This goes beyond previous methods, according to the quantitative evaluation on the CAPE and Renderpeople datasets. Perceptual studies also show that ECON's perceived realism is better by a large margin. Code and models are available for research purposes at econ.is.tue.mpg.de

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

YuliangXiu/ECON officialmentioned in papermentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human ReconstructionSurface Reconstruction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Reconstruction 4D-DRESS ECON_Inner Chamfer (cm) 2.543 #13 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS ECON_Inner IoU 0.736 #13 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS ECON_Inner Normal Consistency 0.796 #13 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS ECON_Outer Chamfer (cm) 2.852 #18 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS ECON_Outer IoU 0.728 #18 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS ECON_Outer Normal Consistency 0.760 #18 of 22 Archive leaderboard report
3D Human Reconstruction CustomHumans ECON Chamfer Distance P-to-S 2.483 #7 of 8 Archive leaderboard report
3D Human Reconstruction CustomHumans ECON Chamfer Distance S-to-P 2.680 #7 of 8 Archive leaderboard report
3D Human Reconstruction CustomHumans ECON Normal Consistency 0.797 #7 of 8 Archive leaderboard report
3D Human Reconstruction CustomHumans ECON f-Score 30.894 #7 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections