Papers › Facial Expression Recognition using Convolutional Neural Networks: State of the Art

Facial Expression Recognition using Convolutional Neural Networks: State of the Art

9 Dec 2016arXiv:1612.02903archive 2025-07-28

Christopher Pramerdorfer, Martin Kampel

The ability to recognize facial expressions automatically enables novel applications in human-computer interaction and other areas. Consequently, there has been active research in this field, with several recent works utilizing Convolutional Neural Networks (CNNs) for feature extraction and inference. These works differ significantly in terms of CNN architectures and other factors. Based on the reported results alone, the performance impact of these factors is unclear. In this paper, we review the state of the art in image-based facial expression recognition using CNNs and highlight algorithmic differences and their performance impact. On this basis, we identify existing bottlenecks and consequently directions for advancing this research field. Furthermore, we demonstrate that overcoming one of these bottlenecks - the comparatively basic architectures of the CNNs utilized in this field - leads to a substantial performance increase. By forming an ensemble of modern deep CNNs, we obtain a FER2013 test accuracy of 75.2%, outperforming previous works without requiring auxiliary training data or face registration.

PaperPDFCode

Code

amilkh/cs230-fer mentioned on GitHub report
apuayush/face_express mentioned on GitHub report
janZub-AI/EmotionDetectionVGG mentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Facial Expression Recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Facial Expression Recognition FER2013 VGG Accuracy 72.7 #1 of 3 Archive leaderboard report
Facial Expression Recognition FER2013 Res-Net Accuracy 72.4 #2 of 3 Archive leaderboard report
Facial Expression Recognition FER2013 Inception Accuracy 71.6 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections