{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/real-time-convolutional-neural-networks-for","title":"Real-time Convolutional Neural Networks for Emotion and Gender Classification","arxiv_id":"1710.07557","date":"2017-10-20","proceeding":null,"authors":["Octavio Arriaga","Matias Valdenegro-Toro","Paul Plöger"],"abstract":"In this paper we propose an implement a general convolutional neural network\n(CNN) building framework for designing real-time CNNs. We validate our models\nby creating a real-time vision system which accomplishes the tasks of face\ndetection, gender classification and emotion classification simultaneously in\none blended step using our proposed CNN architecture. After presenting the\ndetails of the training procedure setup we proceed to evaluate on standard\nbenchmark sets. We report accuracies of 96% in the IMDB gender dataset and 66%\nin the FER-2013 emotion dataset. Along with this we also introduced the very\nrecent real-time enabled guided back-propagation visualization technique.\nGuided back-propagation uncovers the dynamics of the weight changes and\nevaluates the learned features. We argue that the careful implementation of\nmodern CNN architectures, the use of the current regularization methods and the\nvisualization of previously hidden features are necessary in order to reduce\nthe gap between slow performances and real-time architectures. Our system has\nbeen validated by its deployment on a Care-O-bot 3 robot used during\nRoboCup@Home competitions. All our code, demos and pre-trained architectures\nhave been released under an open-source license in our public repository.","url_abs":"http://arxiv.org/abs/1710.07557v1","url_pdf":"http://arxiv.org/pdf/1710.07557v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/oarriaga/face_classification","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/AmrElsersy/Emotions-Recognition","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/CaedenZ/distractionModel","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/CodeChefVIT/VOID","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/ajinkyabedekar/Face-to-Emoji","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/anshu123priya/Real-v-s-Fake-Emotion-Challenge","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/anshu123priya/Real-vs-Fake-Emotion-Challenge","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/foxer9developer/Face-Emotion-to-Emoji-Convertor","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/gscdit/Mood-Analysis","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MPL-2.0"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/kbsriharsha/FacialEmotionAnalysis","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/kumarnikhil936/Facial-Emotion-Recognition","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/moado/expression_recognition","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/rnradon/gender_emotion_classification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/sherkhan15/distarctor-Detection_Eyes_Emotions_CI","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/tahasamavati/facial_expression_recognition_cnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/vicksam/fer-model","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/wapping/FaceClassification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"paddle","reach":{"status":"ok"}},{"paper_slug":"real-time-convolutional-neural-networks-for","repo_url":"https://github.com/superaidou123/face_classification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":{"status":"ok"}}],"tasks":[{"task_slug":"emotion-classification","task_name":"Emotion Classification"},{"task_slug":"face-detection","task_name":"Face Detection"},{"task_slug":"gender-classification","task_name":"Gender Classification"},{"task_slug":"gender-prediction","task_name":"Gender Prediction"},{"task_slug":"classification","task_name":"General Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1710.07557","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1710.07557"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kbsriharsha/FacialEmotionAnalysis","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/CaedenZ/distractionModel","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/vicksam/fer-model","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kumarnikhil936/Facial-Emotion-Recognition","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/moado/expression_recognition","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/superaidou123/face_classification","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tahasamavati/facial_expression_recognition_cnn","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gscdit/Mood-Analysis","reach":{"status":"ok","spdx":"MPL-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wapping/FaceClassification","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/anshu123priya/Real-v-s-Fake-Emotion-Challenge","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/anshu123priya/Real-vs-Fake-Emotion-Challenge","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rnradon/gender_emotion_classification","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/CodeChefVIT/VOID","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/oarriaga/face_classification","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ajinkyabedekar/Face-to-Emoji","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/foxer9developer/Face-Emotion-to-Emoji-Convertor","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/AmrElsersy/Emotions-Recognition","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sherkhan15/distarctor-Detection_Eyes_Emotions_CI","reach":{"status":"ok"}}],"summary":{"ran_violates":1,"unverified":16},"by_repo_kind":{"official":{"samples":12,"ran":1,"repositories":1},"listed":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9a37dad461d6891c","entry":"target_category_loss_output_shape","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/grad_cam.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/grad_cam.py","link_basis":"plan_row","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9a37dad461d6891c"}},{"code_sha256_prefix":"8c0c55fa5e55bece","entry":"cnn_model","repo":"kbsriharsha/FacialEmotionAnalysis","repo_kind":"listed","path":"src/models.py","file_url":"https://github.com/kbsriharsha/FacialEmotionAnalysis/blob/HEAD/src/models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c0c55fa5e55bece"}},{"code_sha256_prefix":"ea715a0ce88dd115","entry":"detect_faces","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/inference.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea715a0ce88dd115"}},{"code_sha256_prefix":"9bb714a4a4dae579","entry":"get_class_to_arg","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/datasets.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9bb714a4a4dae579"}},{"code_sha256_prefix":"01103e164586ab01","entry":"get_labels","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/datasets.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"01103e164586ab01"}},{"code_sha256_prefix":"00501621475bd518","entry":"load_data","repo":"kbsriharsha/FacialEmotionAnalysis","repo_kind":"listed","path":"src/preprocessing.py","file_url":"https://github.com/kbsriharsha/FacialEmotionAnalysis/blob/HEAD/src/preprocessing.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00501621475bd518"}},{"code_sha256_prefix":"96416b6ab9161616","entry":"load_detection_model","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/inference.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"96416b6ab9161616"}},{"code_sha256_prefix":"09594e7b78e84cce","entry":"load_image","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/inference.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09594e7b78e84cce"}},{"code_sha256_prefix":"f94b7628171c3c3f","entry":"mini_xception","repo":"kbsriharsha/FacialEmotionAnalysis","repo_kind":"listed","path":"src/models.py","file_url":"https://github.com/kbsriharsha/FacialEmotionAnalysis/blob/HEAD/src/models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f94b7628171c3c3f"}},{"code_sha256_prefix":"63b6fe40629c7060","entry":"normalize","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/grad_cam.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/grad_cam.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"63b6fe40629c7060"}},{"code_sha256_prefix":"c0ce67208d8c54a6","entry":"preprocess_input","repo":"kbsriharsha/FacialEmotionAnalysis","repo_kind":"listed","path":"src/preprocessing.py","file_url":"https://github.com/kbsriharsha/FacialEmotionAnalysis/blob/HEAD/src/preprocessing.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c0ce67208d8c54a6"}},{"code_sha256_prefix":"e8c2e8860568415c","entry":"preprocess_predict","repo":"kbsriharsha/FacialEmotionAnalysis","repo_kind":"listed","path":"src/preprocessing.py","file_url":"https://github.com/kbsriharsha/FacialEmotionAnalysis/blob/HEAD/src/preprocessing.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e8c2e8860568415c"}},{"code_sha256_prefix":"288f965ba17d3dc1","entry":"simple_CNN","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/models/cnn.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/models/cnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"288f965ba17d3dc1"}},{"code_sha256_prefix":"f17350e0fc08aaa3","entry":"simpler_CNN","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/models/cnn.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/models/cnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f17350e0fc08aaa3"}},{"code_sha256_prefix":"de394cf0581e86de","entry":"split_imdb_data","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/datasets.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de394cf0581e86de"}},{"code_sha256_prefix":"3b921b99ecf61bef","entry":"target_category_loss","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/utils/grad_cam.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/utils/grad_cam.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b921b99ecf61bef"}},{"code_sha256_prefix":"df94886fbbf70773","entry":"tiny_XCEPTION","repo":"oarriaga/face_classification","repo_kind":"official","path":"src/models/cnn.py","file_url":"https://github.com/oarriaga/face_classification/blob/HEAD/src/models/cnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df94886fbbf70773"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}