Papers › Local Learning with Deep and Handcrafted Features for Facial Expression Recognition
Local Learning with Deep and Handcrafted Features for Facial Expression Recognition
Mariana-Iuliana Georgescu, Radu Tudor Ionescu, Marius Popescu
We present an approach that combines automatic features learned by convolutional neural networks (CNN) and handcrafted features computed by the bag-of-visual-words (BOVW) model in order to achieve state-of-the-art results in facial expression recognition. To obtain automatic features, we experiment with multiple CNN architectures, pre-trained models and training procedures, e.g. Dense-Sparse-Dense. After fusing the two types of features, we employ a local learning framework to predict the class label for each test image. The local learning framework is based on three steps. First, a k-nearest neighbors model is applied in order to select the nearest training samples for an input test image. Second, a one-versus-all Support Vector Machines (SVM) classifier is trained on the selected training samples. Finally, the SVM classifier is used to predict the class label only for the test image it was trained for. Although we have used local learning in combination with handcrafted features in our previous work, to the best of our knowledge, local learning has never been employed in combination with deep features. The experiments on the 2013 Facial Expression Recognition (FER) Challenge data set, the FER+ data set and the AffectNet data set demonstrate that our approach achieves state-of-the-art results. With a top accuracy of 75.42% on FER 2013, 87.76% on the FER+, 59.58% on AffectNet 8-way classification and 63.31% on AffectNet 7-way classification, we surpass the state-of-the-art methods by more than 1% on all data sets.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Facial Expression Recognition (FER) | AffectNet | CNNs and BOVW + local SVM | Accuracy (7 emotion) | 63.31 | #28 of 50 | Archive leaderboard | report |
| Facial Expression Recognition (FER) | AffectNet | CNNs and BOVW + local SVM | Accuracy (8 emotion) | 59.58 | #28 of 50 | Archive leaderboard | report |
| Facial Expression Recognition (FER) | FER+ | Local Learning Deep + BOW | Accuracy | 87.76 | #13 of 14 | Archive leaderboard | report |
| Facial Expression Recognition (FER) | FER2013 | Local Learning Deep+BOW | Accuracy | 75.42 | #8 of 17 | Archive leaderboard | report |
| Facial Expression Recognition (FER) | FERPlus | Local Learning Deep + BOW | Accuracy(pretrained) | 87.76 | #4 of 4 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections