{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/local-learning-with-deep-and-handcrafted","title":"Local Learning with Deep and Handcrafted Features for Facial Expression Recognition","arxiv_id":"1804.10892","date":"2018-04-29","proceeding":null,"authors":["Mariana-Iuliana Georgescu","Radu Tudor Ionescu","Marius Popescu"],"abstract":"We present an approach that combines automatic features learned by convolutional neural networks (CNN) and handcrafted features computed by the bag-of-visual-words (BOVW) model in order to achieve state-of-the-art results in facial expression recognition. To obtain automatic features, we experiment with multiple CNN architectures, pre-trained models and training procedures, e.g. Dense-Sparse-Dense. After fusing the two types of features, we employ a local learning framework to predict the class label for each test image. The local learning framework is based on three steps. First, a k-nearest neighbors model is applied in order to select the nearest training samples for an input test image. Second, a one-versus-all Support Vector Machines (SVM) classifier is trained on the selected training samples. Finally, the SVM classifier is used to predict the class label only for the test image it was trained for. Although we have used local learning in combination with handcrafted features in our previous work, to the best of our knowledge, local learning has never been employed in combination with deep features. The experiments on the 2013 Facial Expression Recognition (FER) Challenge data set, the FER+ data set and the AffectNet data set demonstrate that our approach achieves state-of-the-art results. With a top accuracy of 75.42% on FER 2013, 87.76% on the FER+, 59.58% on AffectNet 8-way classification and 63.31% on AffectNet 7-way classification, we surpass the state-of-the-art methods by more than 1% on all data sets.","url_abs":"https://arxiv.org/abs/1804.10892v7","url_pdf":"https://arxiv.org/pdf/1804.10892v7.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"facial-expression-recognition-1","task_name":"Facial Expression Recognition"},{"task_slug":"facial-expression-recognition","task_name":"Facial Expression Recognition (FER)"},{"task_slug":"classification","task_name":"General Classification"}],"methods":[{"method_slug":"svm","method_name":"SVM"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/facial-expression-recognition-on-affectnet","task":"Facial Expression Recognition (FER)","dataset":"AffectNet","model":"CNNs and BOVW + local SVM","rank_in_archive_order":28,"of":50,"metrics":{"Accuracy (7 emotion)":"63.31","Accuracy (8 emotion)":"59.58"},"uses_additional_data":false},{"leaderboard":"/sota/facial-expression-recognition-on-fer-1","task":"Facial Expression Recognition (FER)","dataset":"FER+","model":"Local Learning Deep + BOW","rank_in_archive_order":13,"of":14,"metrics":{"Accuracy":"87.76"},"uses_additional_data":false},{"leaderboard":"/sota/facial-expression-recognition-on-fer2013","task":"Facial Expression Recognition (FER)","dataset":"FER2013","model":"Local Learning Deep+BOW","rank_in_archive_order":8,"of":17,"metrics":{"Accuracy":"75.42"},"uses_additional_data":true},{"leaderboard":"/sota/facial-expression-recognition-on-ferplus","task":"Facial Expression Recognition (FER)","dataset":"FERPlus","model":"Local Learning Deep + BOW","rank_in_archive_order":4,"of":4,"metrics":{"Accuracy(pretrained)":"87.76"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}