Papers › SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video

30 Jan 2022CVPR 2022 1arXiv:2201.12792archive 2025-07-28

Boyi Jiang, Yang Hong, Hujun Bao, Juyong Zhang

We propose SelfRecon, a clothed human body reconstruction method that combines implicit and explicit representations to recover space-time coherent geometries from a monocular self-rotating human video. Explicit methods require a predefined template mesh for a given sequence, while the template is hard to acquire for a specific subject. Meanwhile, the fixed topology limits the reconstruction accuracy and clothing types. Implicit representation supports arbitrary topology and can represent high-fidelity geometry shapes due to its continuous nature. However, it is difficult to integrate multi-frame information to produce a consistent registration sequence for downstream applications. We propose to combine the advantages of both representations. We utilize differential mask loss of the explicit mesh to obtain the coherent overall shape, while the details on the implicit surface are refined with the differentiable neural rendering. Meanwhile, the explicit mesh is updated periodically to adjust its topology changes, and a consistency loss is designed to match both representations. Compared with existing methods, SelfRecon can produce high-fidelity surfaces for arbitrary clothed humans with self-supervised optimization. Extensive experimental results demonstrate its effectiveness on real captured monocular videos. The source code is available at https://github.com/jby1993/SelfReconCode.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

jby1993/selfreconcode officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human ReconstructionNeural Rendering

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Reconstruction 4D-DRESS SelfRecon_Outer Chamfer (cm) 3.014 #20 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS SelfRecon_Outer IoU 0.787 #20 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS SelfRecon_Outer Normal Consistency 0.725 #20 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS SelfRecon_Inner Chamfer (cm) 3.180 #21 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS SelfRecon_Inner IoU 0.754 #21 of 22 Archive leaderboard report
3D Human Reconstruction 4D-DRESS SelfRecon_Inner Normal Consistency 0.729 #21 of 22 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections