Papers › 3D face reconstruction with dense landmarks

3D face reconstruction with dense landmarks

6 Apr 2022arXiv:2204.02776archive 2025-07-28

Erroll Wood, Tadas Baltrusaitis, Charlie Hewitt, Matthew Johnson, Jingjing Shen, Nikola Milosavljevic, Daniel Wilde, Stephan Garbin, Chirag Raman, Jamie Shotton, Toby Sharp, Ivan Stojiljkovic, Tom Cashman, Julien Valentin

Landmarks often play a key role in face analysis, but many aspects of identity or expression cannot be represented by sparse landmarks alone. Thus, in order to reconstruct faces more accurately, landmarks are often combined with additional signals like depth images or techniques like differentiable rendering. Can we keep things simple by just using more landmarks? In answer, we present the first method that accurately predicts 10x as many landmarks as usual, covering the whole head, including the eyes and teeth. This is accomplished using synthetic training data, which guarantees perfect landmark annotations. By fitting a morphable model to these dense landmarks, we achieve state-of-the-art results for monocular 3D face reconstruction in the wild. We show that dense landmarks are an ideal signal for integrating face shape information across frames by demonstrating accurate and expressive facial performance capture in both monocular and multi-view scenarios. This approach is also highly efficient: we can predict dense landmarks and fit our 3D face model at over 150FPS on a single CPU thread. Please see our website: https://microsoft.github.io/DenseLandmarks/.

PaperPDF

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Face ReconstructionFace AlignmentFace ModelFace Reconstruction

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Face Reconstruction Florence DenseLandmarks (Multi-view) RMSE Cooperative 1.43 #9 of 16 Archive leaderboard report
3D Face Reconstruction Florence DenseLandmarks (Multi-view) RMSE Indoor 1.42 #9 of 16 Archive leaderboard report
3D Face Reconstruction Florence DenseLandmarks (Multi-view) RMSE Outdoor 1.42 #9 of 16 Archive leaderboard report
3D Face Reconstruction Florence DenseLandmarks (Single-view) RMSE Cooperative 1.64 #11 of 16 Archive leaderboard report
3D Face Reconstruction Florence DenseLandmarks (Single-view) RMSE Indoor 1.62 #11 of 16 Archive leaderboard report
3D Face Reconstruction Florence DenseLandmarks (Single-view) RMSE Outdoor 1.61 #11 of 16 Archive leaderboard report
3D Face Reconstruction NoW Benchmark DenseLandmarks (Multi-view) Mean Reconstruction Error (mm) 1.01 #1 of 17 Archive leaderboard report
3D Face Reconstruction NoW Benchmark DenseLandmarks (Multi-view) Median Reconstruction Error 0.81 #1 of 17 Archive leaderboard report
3D Face Reconstruction NoW Benchmark DenseLandmarks (Multi-view) Stdev Reconstruction Error (mm) 0.84 #1 of 17 Archive leaderboard report
3D Face Reconstruction NoW Benchmark DenseLandmarks (Single-view) Mean Reconstruction Error (mm) 1.28 #3 of 17 Archive leaderboard report
3D Face Reconstruction NoW Benchmark DenseLandmarks (Single-view) Median Reconstruction Error 1.02 #3 of 17 Archive leaderboard report
3D Face Reconstruction NoW Benchmark DenseLandmarks (Single-view) Stdev Reconstruction Error (mm) 1.08 #3 of 17 Archive leaderboard report
Face Alignment 300W DenseLandmarks (GNLL) NME_inter-ocular (%, Challenge) 4.8 #44 of 48 Archive leaderboard report
Face Alignment 300W DenseLandmarks (GNLL) NME_inter-ocular (%, Common) 3.03 #44 of 48 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections