Papers › 3D face reconstruction with dense landmarks
3D face reconstruction with dense landmarks
Erroll Wood, Tadas Baltrusaitis, Charlie Hewitt, Matthew Johnson, Jingjing Shen, Nikola Milosavljevic, Daniel Wilde, Stephan Garbin, Chirag Raman, Jamie Shotton, Toby Sharp, Ivan Stojiljkovic, Tom Cashman, Julien Valentin
Landmarks often play a key role in face analysis, but many aspects of identity or expression cannot be represented by sparse landmarks alone. Thus, in order to reconstruct faces more accurately, landmarks are often combined with additional signals like depth images or techniques like differentiable rendering. Can we keep things simple by just using more landmarks? In answer, we present the first method that accurately predicts 10x as many landmarks as usual, covering the whole head, including the eyes and teeth. This is accomplished using synthetic training data, which guarantees perfect landmark annotations. By fitting a morphable model to these dense landmarks, we achieve state-of-the-art results for monocular 3D face reconstruction in the wild. We show that dense landmarks are an ideal signal for integrating face shape information across frames by demonstrating accurate and expressive facial performance capture in both monocular and multi-view scenarios. This approach is also highly efficient: we can predict dense landmarks and fit our 3D face model at over 150FPS on a single CPU thread. Please see our website: https://microsoft.github.io/DenseLandmarks/.
In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.
Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
1 archive task tag without a task page not shown.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D Face Reconstruction | Florence | DenseLandmarks (Multi-view) | RMSE Cooperative | 1.43 | #9 of 16 | Archive leaderboard | report |
| 3D Face Reconstruction | Florence | DenseLandmarks (Multi-view) | RMSE Indoor | 1.42 | #9 of 16 | Archive leaderboard | report |
| 3D Face Reconstruction | Florence | DenseLandmarks (Multi-view) | RMSE Outdoor | 1.42 | #9 of 16 | Archive leaderboard | report |
| 3D Face Reconstruction | Florence | DenseLandmarks (Single-view) | RMSE Cooperative | 1.64 | #11 of 16 | Archive leaderboard | report |
| 3D Face Reconstruction | Florence | DenseLandmarks (Single-view) | RMSE Indoor | 1.62 | #11 of 16 | Archive leaderboard | report |
| 3D Face Reconstruction | Florence | DenseLandmarks (Single-view) | RMSE Outdoor | 1.61 | #11 of 16 | Archive leaderboard | report |
| 3D Face Reconstruction | NoW Benchmark | DenseLandmarks (Multi-view) | Mean Reconstruction Error (mm) | 1.01 | #1 of 17 | Archive leaderboard | report |
| 3D Face Reconstruction | NoW Benchmark | DenseLandmarks (Multi-view) | Median Reconstruction Error | 0.81 | #1 of 17 | Archive leaderboard | report |
| 3D Face Reconstruction | NoW Benchmark | DenseLandmarks (Multi-view) | Stdev Reconstruction Error (mm) | 0.84 | #1 of 17 | Archive leaderboard | report |
| 3D Face Reconstruction | NoW Benchmark | DenseLandmarks (Single-view) | Mean Reconstruction Error (mm) | 1.28 | #3 of 17 | Archive leaderboard | report |
| 3D Face Reconstruction | NoW Benchmark | DenseLandmarks (Single-view) | Median Reconstruction Error | 1.02 | #3 of 17 | Archive leaderboard | report |
| 3D Face Reconstruction | NoW Benchmark | DenseLandmarks (Single-view) | Stdev Reconstruction Error (mm) | 1.08 | #3 of 17 | Archive leaderboard | report |
| Face Alignment | 300W | DenseLandmarks (GNLL) | NME_inter-ocular (%, Challenge) | 4.8 | #44 of 48 | Archive leaderboard | report |
| Face Alignment | 300W | DenseLandmarks (GNLL) | NME_inter-ocular (%, Common) | 3.03 | #44 of 48 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections