Papers › QCS: Feature Refining from Quadruplet Cross Similarity for Facial Expression Recognition

QCS: Feature Refining from Quadruplet Cross Similarity for Facial Expression Recognition

4 Nov 2024arXiv:2411.01988archive 2025-07-28

Chengpeng Wang, Li Chen, Lili Wang, Zhaofan Li, Xuebin Lv

Facial expression recognition faces challenges where labeled significant features in datasets are mixed with unlabeled redundant ones. In this paper, we introduce Cross Similarity Attention (CSA) to mine richer intrinsic information from image pairs, overcoming a limitation when the Scaled Dot-Product Attention of ViT is directly applied to calculate the similarity between two different images. Based on CSA, we simultaneously minimize intra-class differences and maximize inter-class differences at the fine-grained feature level through interactions among multiple branches. Contrastive residual distillation is utilized to transfer the information learned in the cross module back to the base network. We ingeniously design a four-branch centrally symmetric network, named Quadruplet Cross Similarity (QCS), which alleviates gradient conflicts arising from the cross module and achieves balanced and stable training. It can adaptively extract discriminative features while isolating redundant ones. The cross-attention modules exist during training, and only one base branch is retained during inference, resulting in no increase in inference time. Extensive experiments show that our proposed method achieves state-of-the-art performance on several FER datasets.

PaperPDFCode

Code

birdwcp/qcs officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Facial Expression RecognitionFacial Expression Recognition (FER)

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Facial Expression Recognition (FER) AffectNet QCS Accuracy (7 emotion) 67.94 #4 of 50 Archive leaderboard report
Facial Expression Recognition (FER) AffectNet QCS Accuracy (8 emotion) 64.4 #4 of 50 Archive leaderboard report
Facial Expression Recognition (FER) FER+ QCS Accuracy 91.85 #3 of 14 Archive leaderboard report
Facial Expression Recognition (FER) RAF-DB QCS Overall Accuracy 93.02 #3 of 35 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AttentionBASEConcatenated Skip ConnectionSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections