Papers › Super-FAN: Integrated facial landmark localization and super-resolution of real-world...

Super-FAN: Integrated facial landmark localization and super-resolution of real-world low resolution faces in arbitrary poses with GANs

7 Dec 2017CVPR 2018 6arXiv:1712.02765archive 2025-07-28

Adrian Bulat, Georgios Tzimiropoulos

This paper addresses 2 challenging tasks: improving the quality of low resolution facial images and accurately locating the facial landmarks on such poor resolution images. To this end, we make the following 5 contributions: (a) we propose Super-FAN: the very first end-to-end system that addresses both tasks simultaneously, i.e. both improves face resolution and detects the facial landmarks. The novelty or Super-FAN lies in incorporating structural information in a GAN-based super-resolution algorithm via integrating a sub-network for face alignment through heatmap regression and optimizing a novel heatmap loss. (b) We illustrate the benefit of training the two networks jointly by reporting good results not only on frontal images (as in prior work) but on the whole spectrum of facial poses, and not only on synthetic low resolution images (as in prior work) but also on real-world images. (c) We improve upon the state-of-the-art in face super-resolution by proposing a new residual-based architecture. (d) Quantitatively, we show large improvement over the state-of-the-art for both face super-resolution and alignment. (e) Qualitatively, we show for the first time good results on real-world low resolution images.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Face AlignmentFace HallucinationImage Super-ResolutionSuper-Resolution

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Face Hallucination FFHQ 512 x 512 - 16x upscaling Super-FAN FID 63.693 #4 of 4 Archive leaderboard report
Face Hallucination FFHQ 512 x 512 - 16x upscaling Super-FAN LPIPS 0.4411 #4 of 4 Archive leaderboard report
Face Hallucination FFHQ 512 x 512 - 16x upscaling Super-FAN NIQE 7.444 #4 of 4 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN FED 0.1416 #8 of 8 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN FID 14.811 #8 of 8 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN LLE 2.333 #8 of 8 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN LPIPS 0.2357 #8 of 8 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN MS-SSIM 0.913 #8 of 8 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN NIQE 8.719 #8 of 8 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN PSNR 25.463 #8 of 8 Archive leaderboard report
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling Super-FAN SSIM 0.729 #8 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Heatmap

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections