Papers › Fake It Till You Make It: Face analysis in the wild using synthetic data alone

Fake It Till You Make It: Face analysis in the wild using synthetic data alone

30 Sep 2021ICCV 2021 10arXiv:2109.15102archive 2025-07-28

Erroll Wood, Tadas Baltrušaitis, Charlie Hewitt, Sebastian Dziadzio, Matthew Johnson, Virginia Estellers, Thomas J. Cashman, Jamie Shotton

We demonstrate that it is possible to perform face-related computer vision in the wild using synthetic data alone. The community has long enjoyed the benefits of synthesizing training data with graphics, but the domain gap between real and synthetic data has remained a problem, especially for human faces. Researchers have tried to bridge this gap with data mixing, domain adaptation, and domain-adversarial training, but we show that it is possible to synthesize data with minimal domain gap, so that models trained on synthetic data generalize to real in-the-wild datasets. We describe how to combine a procedurally-generated parametric 3D face model with a comprehensive library of hand-crafted assets to render training images with unprecedented realism and diversity. We train machine learning systems for face-related tasks such as landmark localization and face parsing, showing that synthetic data can both match real data in accuracy as well as open up new approaches where manual labelling would be impossible.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DiversityDomain AdaptationFace AlignmentFace ModelFace Parsing

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Face Alignment 300W FakeIt NME_inter-ocular (%, Challenge) 4.86 #45 of 48 Archive leaderboard report
Face Alignment 300W FakeIt NME_inter-ocular (%, Common) 3.09 #45 of 48 Archive leaderboard report
Face Parsing Helen UNet (synthetic) Mean F1 92 #2 of 3 Archive leaderboard report
Face Parsing Helen UNet (real) Mean F1 91.6 #3 of 3 Archive leaderboard report
Face Parsing LaPa UNet (real) Mean F1 90.9 #7 of 11 Archive leaderboard report
Face Parsing LaPa UNet (synthetic) Mean F1 90.1 #8 of 11 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections