Papers › Norface: Improving Facial Expression Analysis by Identity Normalization

Norface: Improving Facial Expression Analysis by Identity Normalization

22 Jul 2024arXiv:2407.15617archive 2025-07-28

Hanwei Liu, Rudong An, Zhimeng Zhang, Bowen Ma, Wei zhang, Yan Song, Yujing Hu, Wei Chen, Yu Ding

Facial Expression Analysis remains a challenging task due to unexpected task-irrelevant noise, such as identity, head pose, and background. To address this issue, this paper proposes a novel framework, called Norface, that is unified for both Action Unit (AU) analysis and Facial Emotion Recognition (FER) tasks. Norface consists of a normalization network and a classification network. First, the carefully designed normalization network struggles to directly remove the above task-irrelevant noise, by maintaining facial expression consistency but normalizing all original images to a common identity with consistent pose, and background. Then, these additional normalized images are fed into the classification network. Due to consistent identity and other factors (e.g. head pose, background, etc.), the normalized images enable the classification network to extract useful expression information more effectively. Additionally, the classification network incorporates a Mixture of Experts to refine the latent representation, including handling the input of facial representations and the output of multiple (AU or emotion) labels. Extensive experiments validate the carefully designed framework with the insight of identity normalization. The proposed method outperforms existing SOTA methods in multiple facial expression analysis tasks, including AU detection, AU intensity estimation, and FER tasks, as well as their cross-dataset tasks. For the normalized datasets and code please visit {https://norface-fea.github.io/}.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

liuhw01/Norface officialmentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ClassificationEmotion RecognitionFacial Action Unit DetectionFacial Emotion RecognitionFacial Expression Recognition (FER)Mixture-of-Experts

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Facial Action Unit Detection BP4D+ Norface Average F1 66.7 #2 of 3 Archive leaderboard report
Facial Action Unit Detection DISFA Norface Average F1 72.7 #1 of 8 Archive leaderboard report
Facial Expression Recognition (FER) AffectNet Norface Accuracy (8 emotion) 68.69 #1 of 50 Archive leaderboard report
Facial Expression Recognition (FER) BP4D Norface ICC 0.74 #1 of 2 Archive leaderboard report
Facial Expression Recognition (FER) DISFA Norface ICC 0.67 #1 of 2 Archive leaderboard report
Facial Expression Recognition (FER) RAF-DB Norface Overall Accuracy 92.97 #4 of 35 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections