Papers › Mini-ResEmoteNet: Leveraging Knowledge Distillation for Human-Centered Design

Mini-ResEmoteNet: Leveraging Knowledge Distillation for Human-Centered Design

30 Jan 2025arXiv:2501.18538archive 2025-07-28

Amna Murtada, Omnia Abdelrhman, Tahani Abdalla Attia

Facial Emotion Recognition has emerged as increasingly pivotal in the domain of User Experience, notably within modern usability testing, as it facilitates a deeper comprehension of user satisfaction and engagement. This study aims to extend the ResEmoteNet model by employing a knowledge distillation framework to develop Mini-ResEmoteNet models - lightweight student models - tailored for usability testing. Experiments were conducted on the FER2013 and RAF-DB datasets to assess the efficacy of three student model architectures: Student Model A, Student Model B, and Student Model C. Their development involves reducing the number of feature channels in each layer of the teacher model by approximately 50%, 75%, and 87.5%. Demonstrating exceptional performance on the FER2013 dataset, Student Model A (E1) achieved a test accuracy of 76.33%, marking a 0.21% absolute improvement over EmoNeXt. Moreover, the results exhibit absolute improvements in terms of inference speed and memory usage during inference compared to the ResEmoteNet model. The findings indicate that the proposed methods surpass other state-of-the-art approaches.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Emotion RecognitionFacial Emotion RecognitionFacial Expression Recognition (FER)Knowledge Distillation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Facial Expression Recognition (FER) FER2013 Mini-ResEmoteNet (A) Accuracy 76.33 #5 of 17 Archive leaderboard report
Facial Expression Recognition (FER) FER2013 Mini-ResEmoteNet (B) Accuracy 70.20 #15 of 17 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Knowledge DistillationSPEED

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections