Papers › Towards Robust Blind Face Restoration with Codebook Lookup Transformer

Towards Robust Blind Face Restoration with Codebook Lookup Transformer

22 Jun 2022arXiv:2206.11253archive 2025-07-28

Shangchen Zhou, Kelvin C. K. Chan, Chongyi Li, Chen Change Loy

Blind face restoration is a highly ill-posed problem that often requires auxiliary guidance to 1) improve the mapping from degraded inputs to desired outputs, or 2) complement high-quality details lost in the inputs. In this paper, we demonstrate that a learned discrete codebook prior in a small proxy space largely reduces the uncertainty and ambiguity of restoration mapping by casting blind face restoration as a code prediction task, while providing rich visual atoms for generating high-quality faces. Under this paradigm, we propose a Transformer-based prediction network, named CodeFormer, to model the global composition and context of the low-quality faces for code prediction, enabling the discovery of natural faces that closely approximate the target faces even when the inputs are severely degraded. To enhance the adaptiveness for different degradation, we also propose a controllable feature transformation module that allows a flexible trade-off between fidelity and quality. Thanks to the expressive codebook prior and global modeling, CodeFormer outperforms the state of the arts in both quality and fidelity, showing superior robustness to degradation. Extensive experimental results on synthetic and real-world datasets verify the effectiveness of our method.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

sczhou/codeformer officialmentioned in papermentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Blind Face RestorationPrediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Blind Face Restoration CelebA-Test CodeFormer FID 60.62 #1 of 15 Archive leaderboard report
Blind Face Restoration CelebA-Test CodeFormer IDS 60 #1 of 15 Archive leaderboard report
Blind Face Restoration CelebA-Test CodeFormer LPIPS 29.9 #1 of 15 Archive leaderboard report
Blind Face Restoration CelebA-Test CodeFormer PSNR 22.18 #1 of 15 Archive leaderboard report
Blind Face Restoration CelebA-Test CodeFormer SSIM 0.61 #1 of 15 Archive leaderboard report
Blind Face Restoration LFW GFP-GAN FID 49.96 #3 of 9 Archive leaderboard report
Blind Face Restoration LFW PSFRGAN FID 51.89 #4 of 9 Archive leaderboard report
Blind Face Restoration LFW CodeFormer FID 52.02 #5 of 9 Archive leaderboard report
Blind Face Restoration LFW GLEAN FID 53.49 #6 of 9 Archive leaderboard report
Blind Face Restoration LFW GPEN FID 57.58 #7 of 9 Archive leaderboard report
Blind Face Restoration LFW DFDNet FID 62.57 #8 of 9 Archive leaderboard report
Blind Face Restoration LFW PULSE FID 64.86 #9 of 9 Archive leaderboard report
Blind Face Restoration WIDER CodeFormer FID 39.06 #3 of 9 Archive leaderboard report
Blind Face Restoration WIDER GFP-GAN FID 40.59 #4 of 9 Archive leaderboard report
Blind Face Restoration WIDER GPEN FID 46.99 #5 of 9 Archive leaderboard report
Blind Face Restoration WIDER GLEAN FID 47.11 #6 of 9 Archive leaderboard report
Blind Face Restoration WIDER PSFRGAN FID 51.16 #7 of 9 Archive leaderboard report
Blind Face Restoration WIDER DFDNet FID 57.84 #8 of 9 Archive leaderboard report
Blind Face Restoration WIDER PULSE FID 73.59 #9 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections