Papers › Towards High-fidelity Nonlinear 3D Face Morphable Model

Towards High-fidelity Nonlinear 3D Face Morphable Model

9 Apr 2019CVPR 2019 6arXiv:1904.04933archive 2025-07-28

Luan Tran, Feng Liu, Xiaoming Liu

Embedding 3D morphable basis functions into deep neural networks opens great potential for models with better representation power. However, to faithfully learn those models from an image collection, it requires strong regularization to overcome ambiguities involved in the learning process. This critically prevents us from learning high fidelity face models which are needed to represent face images in high level of details. To address this problem, this paper presents a novel approach to learn additional proxies as means to side-step strong regularizations, as well as, leverages to promote detailed shape/albedo. To ease the learning, we also propose to use a dual-pathway network, a carefully-designed architecture that brings a balance between global and local-based models. By improving the nonlinear 3D morphable model in both learning objective and network architecture, we present a model which is superior in capturing higher level of details than the linear or its precedent nonlinear counterparts. As a result, our model achieves state-of-the-art performance on 3D face reconstruction by solely optimizing latent representations.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Face ReconstructionFace ReconstructionVocal Bursts Intensity Predictionmodel

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Face Reconstruction REALY N-3DMM @cheek 1.918 (±0.801) #24 of 24 Archive leaderboard report
3D Face Reconstruction REALY N-3DMM @forehead 4.582 (±1.488) #24 of 24 Archive leaderboard report
3D Face Reconstruction REALY N-3DMM @mouth 2.375 (±0.599) #24 of 24 Archive leaderboard report
3D Face Reconstruction REALY N-3DMM @nose 2.936 (±0.810) #24 of 24 Archive leaderboard report
3D Face Reconstruction REALY N-3DMM all 2.953 #24 of 24 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections