Papers › A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction...

A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Images

28 Feb 2023CVPR 2023 1arXiv:2302.14434archive 2025-07-28

Biwen Lei, Jianqiang Ren, Mengyang Feng, Miaomiao Cui, Xuansong Xie

Limited by the nature of the low-dimensional representational capacity of 3DMM, most of the 3DMM-based face reconstruction (FR) methods fail to recover high-frequency facial details, such as wrinkles, dimples, etc. Some attempt to solve the problem by introducing detail maps or non-linear operations, however, the results are still not vivid. To this end, we in this paper present a novel hierarchical representation network (HRN) to achieve accurate and detailed face reconstruction from a single image. Specifically, we implement the geometry disentanglement and introduce the hierarchical representation to fulfill detailed face modeling. Meanwhile, 3D priors of facial details are incorporated to enhance the accuracy and authenticity of the reconstruction results. We also propose a de-retouching module to achieve better decoupling of the geometry and appearance. It is noteworthy that our framework can be extended to a multi-view fashion by considering detail consistency of different views. Extensive experiments on two single-view and two multi-view FR benchmarks demonstrate that our method outperforms the existing methods in both reconstruction accuracy and visual effects. Finally, we introduce a high-quality 3D face dataset FaceHD-100 to boost the research of high-fidelity face reconstruction. The project homepage is at https://younglbw.github.io/HRN-homepage/.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

youngLBW/HRN officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Face ReconstructionDisentanglementFace Reconstruction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Face Reconstruction REALY HRN @cheek 1.072 (±0.333) #6 of 24 Archive leaderboard report
3D Face Reconstruction REALY HRN @forehead 1.995 (±0.476) #6 of 24 Archive leaderboard report
3D Face Reconstruction REALY HRN @mouth 1.357 (±0.523) #6 of 24 Archive leaderboard report
3D Face Reconstruction REALY HRN @nose 1.722 (±0.330) #6 of 24 Archive leaderboard report
3D Face Reconstruction REALY HRN all 1.537 #6 of 24 Archive leaderboard report
3D Face Reconstruction REALY (side-view) HRN @cheek 1.038 (±0.322) #4 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) HRN @forehead 1.906 (±0.479) #4 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) HRN @mouth 1.285 (±0.528) #4 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) HRN @nose 1.642 (±0.310) #4 of 19 Archive leaderboard report
3D Face Reconstruction REALY (side-view) HRN all 1.468 #4 of 19 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

fail

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections