Papers › Batch Transformer: Look for Attention in Batch

Batch Transformer: Look for Attention in Batch

5 Jul 2024arXiv:2407.04218archive 2025-07-28

Myung Beom Her, Jisu Jeong, Hojoon Song, Ji-Hyeong Han

Facial expression recognition (FER) has received considerable attention in computer vision, with "in-the-wild" environments such as human-computer interaction. However, FER images contain uncertainties such as occlusion, low resolution, pose variation, illumination variation, and subjectivity, which includes some expressions that do not match the target label. Consequently, little information is obtained from a noisy single image and it is not trusted. This could significantly degrade the performance of the FER task. To address this issue, we propose a batch transformer (BT), which consists of the proposed class batch attention (CBA) module, to prevent overfitting in noisy data and extract trustworthy information by training on features reflected from several images in a batch, rather than information from a single image. We also propose multi-level attention (MLA) to prevent overfitting the specific features by capturing correlations between each level. In this paper, we present a batch transformer network (BTN) that combines the above proposals. Experimental results on various FER benchmark datasets show that the proposed BTN consistently outperforms the state-ofthe-art in FER datasets. Representative results demonstrate the promise of the proposed BTN for FER.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Facial Expression RecognitionFacial Expression Recognition (FER)

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Facial Expression Recognition (FER) AffectNet BTN Accuracy (7 emotion) 67.60 #5 of 50 Archive leaderboard report
Facial Expression Recognition (FER) AffectNet BTN Accuracy (8 emotion) 64.29 #5 of 50 Archive leaderboard report
Facial Expression Recognition (FER) RAF-DB BTN Avg. Accuracy 87.3 #6 of 35 Archive leaderboard report
Facial Expression Recognition (FER) RAF-DB BTN Overall Accuracy 92.54 #6 of 35 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AttentionSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections