Papers › Multimodal Speech Emotion Recognition and Ambiguity Resolution

Multimodal Speech Emotion Recognition and Ambiguity Resolution

12 Apr 2019arXiv:1904.06022archive 2025-07-28

Gaurav Sahu

Identifying emotion from speech is a non-trivial task pertaining to the ambiguous definition of emotion itself. In this work, we adopt a feature-engineering based approach to tackle the task of speech emotion recognition. Formalizing our problem as a multi-class classification problem, we compare the performance of two categories of models. For both, we extract eight hand-crafted features from the audio signal. In the first approach, the extracted features are used to train six traditional machine learning classifiers, whereas the second approach is based on deep learning wherein a baseline feed-forward neural network and an LSTM-based classifier are trained over the same features. In order to resolve ambiguity in communication, we also include features from the text domain. We report accuracy, f-score, precision, and recall for the different experiment settings we evaluated our models in. Overall, we show that lighter machine learning based models trained over a few hand-crafted features are able to achieve performance comparable to the current deep learning based state-of-the-art method for emotion recognition.

PaperPDFCode

Syntology This paper's arXiv id is not in Syntology's Atlas id list (549,449 ids, as this build read them; the read time is in the build record), so this page links to no Syntology page for it. The list is not the whole graph; Syntology's feed shows papers as they enter the graph.

Code

Cris-Nguyen/Speech-Emotion-Recognition mentioned on GitHubpytorchSyntology: not harvested report
Demfier/multimodal-speech-emotion-recognition mentioned on GitHubpytorchSyntology: not harvested report
MagnusXu/Speech-Emotion-Recognition-Capstone-Project mentioned on GitHubSyntology: not harvested report
SER-2020-Project-ZX/Reference mentioned on GitHubSyntology: not harvested report
adsieg/Speech mentioned on GitHubSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

BIG-bench Machine LearningEmotion RecognitionFeature EngineeringMulti-class ClassificationMultimodal Emotion RecognitionSpeech Emotion Recognition

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections