Papers › Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognition

Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognition

15 Sep 2021arXiv:2109.07270archive 2025-07-28

Zhengyao Wen, Wenzhong Lin, Tao Wang, Ge Xu

We present a novel facial expression recognition network, called Distract your Attention Network (DAN). Our method is based on two key observations. Firstly, multiple classes share inherently similar underlying facial appearance, and their differences could be subtle. Secondly, facial expressions exhibit themselves through multiple facial regions simultaneously, and the recognition requires a holistic approach by encoding high-order interactions among local features. To address these issues, we propose our DAN with three key components: Feature Clustering Network (FCN), Multi-head cross Attention Network (MAN), and Attention Fusion Network (AFN). The FCN extracts robust features by adopting a large-margin learning objective to maximize class separability. In addition, the MAN instantiates a number of attention heads to simultaneously attend to multiple facial areas and build attention maps on these regions. Further, the AFN distracts these attentions to multiple locations before fusing the attention maps to a comprehensive one. Extensive experiments on three public datasets (including AffectNet, RAF-DB, and SFEW 2.0) verified that the proposed method consistently achieves state-of-the-art facial expression recognition performance. Code will be made available at https://github.com/yaoing/DAN.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

yaoing/dan officialmentioned in papermentioned on GitHubpytorch report
sithu31296/EasyFace mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Facial Expression RecognitionFacial Expression Recognition (FER)

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Facial Expression Recognition (FER) AffectNet DAN Accuracy (7 emotion) 65.69 #16 of 50 Archive leaderboard report
Facial Expression Recognition (FER) AffectNet DAN Accuracy (8 emotion) 62.09 #16 of 50 Archive leaderboard report
Facial Expression Recognition (FER) RAF-DB DAN Overall Accuracy 89.70 #18 of 35 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvolutionFCNMax Pooling

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections