Speech Emotion Recognition

Description from the archive archive 2025-07-28; Papers-with-Code links inside it are rewritten to this site.

Benchmarks archive 2025-07-28

16 leaderboard tables shown for this task, 16 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 16 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

22 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

4 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 139 papers with code (431 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Attention Is All You Need
  12 Jun 2017 595 repositories listed Syntology ran 600 of 946 samples · 346 unverified · 451 pointer-only (licence)
  The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration.
• Continuous control with deep reinforcement learning
  9 Sep 2015 161 repositories listed Syntology ran 158 of 306 samples · 148 unverified · 163 pointer-only (licence)
  We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain.
• AST: Audio Spectrogram Transformer
  5 Apr 2021 5 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for end-to-end audio classification models, which aim to learn a direct mapping from audio spectrograms to…
• Multimodal Speech Emotion Recognition and Ambiguity Resolution
  12 Apr 2019 5 repositories listed
  In this work, we adopt a feature-engineering based approach to tackle the task of speech emotion recognition.
• Multimodal Speech Emotion Recognition Using Audio and Text
  10 Oct 2018 4 repositories listed
  Speech emotion recognition is a challenging task, and extensive reliance has been placed on models that use audio features in building well-performing classifiers.
• Speech Emotion Diarization: Which Emotion Appears When?
  22 Jun 2023 3 repositories listed
  Speech Emotion Recognition (SER) typically relies on utterance-level solutions.
• Compact Graph Architecture for Speech Emotion Recognition
  5 Aug 2020 3 repositories listed
  We propose a deep graph approach to address the task of speech emotion recognition.
• CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training
  23 May 2025 2 repositories listed Syntology ran 1 of 4 samples · 3 unverified
  Despite these advancements, CosyVoice 2 exhibits limitations in language coverage, domain diversity, data volume, text formats, and post-training techniques.
• Unveiling Hidden Factors: Explainable AI for Feature Boosting in Speech Emotion Recognition
  1 Jun 2024 2 repositories listed
  The proposed approach offers several advantages, including the identification and removal of irrelevant and redundant features, leading to a more effective model.
• emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
  23 Dec 2023 2 repositories listed Syntology ran 8 of 20 samples · 12 unverified · 9 pointer-only (licence)
  To the best of our knowledge, emotion2vec is the first universal representation model in various emotion-related tasks, filling a gap in the field.
• LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT
  7 Oct 2023 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Previous mainstream audio-and-text LLMs use discrete audio tokens to represent both input and output audio; however, they suffer from performance degradation on tasks such as automatic speech recognition, speech-to-text…
• A Persian ASR-based SER: Modification of Sharif Emotional Speech Database and Investigation of Persian Text Corpora
  18 Nov 2022 2 repositories listed
  Speech Emotion Recognition (SER) is one of the essential perceptual methods of humans in understanding the situation and how to interact with others, therefore, in recent years, it has been tried to add the ability to…
• SERAB: A multi-lingual benchmark for speech emotion recognition
  7 Oct 2021 2 repositories listed Syntology ran 5 of 9 samples · 4 unverified
  To facilitate the process, here, we present the Speech Emotion Recognition Adaptation Benchmark (SERAB), a framework for evaluating the performance and generalization capacity of different approaches for utterance-level…
• Emotion Recognition from Speech Using Wav2vec 2.0 Embeddings
  8 Apr 2021 2 repositories listed
  Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging.
• Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset
  28 Oct 2020 2 repositories listed
  Emotional voice conversion aims to transform emotional prosody in speech while preserving the linguistic content and speaker identity.
• Deep Learning based Emotion Recognition System Using Speech Features and Transcriptions
  11 Jun 2019 2 repositories listed
  This paper proposes a speech emotion recognition method based on speech features and speech transcriptions (text).
• Speech Emotion Recognition Using Multi-hop Attention Mechanism
  23 Apr 2019 2 repositories listed
  As opposed to using knowledge from both the modalities separately, we propose a framework to exploit acoustic information in tandem with lexical data.
• Dynamic Parameter Memory: Temporary LoRA-Enhanced LLM for Long-Sequence Emotion Recognition in Conversation
  11 Jul 2025 1 repository listed
  Recent research has focused on applying speech large language model (SLLM) to improve speech emotion recognition (SER).
• MEDUSA: A Multimodal Deep Fusion Multi-Stage Training Framework for Speech Emotion Recognition in Naturalistic Conditions
  11 Jun 2025 1 repository listed
  SER is a challenging task due to the subjective nature of human emotions and their uneven representation under naturalistic conditions.
• Multi-Teacher Language-Aware Knowledge Distillation for Multilingual Speech Emotion Recognition
  10 Jun 2025 1 repository listed
  It leverages Wav2Vec2.
• MELT: Towards Automated Multimodal Emotion Data Annotation by Leveraging LLM Embedded Knowledge
  30 May 2025 1 repository listed
  We demonstrate the effectiveness of MELT by fine-tuning four self-supervised learning (SSL) backbones and assessing speech emotion recognition performance across emotion datasets.
• Improving Speech Emotion Recognition Through Cross Modal Attention Alignment and Balanced Stacking Model
  26 May 2025 1 repository listed
  This paper presents our proposed system in the context of the 2025 Speech Emotion Recognition in Naturalistic Conditions Challenge.
• EmoSphere-SER: Enhancing Speech Emotion Recognition Through Spherical Representation with Auxiliary Classification
  26 May 2025 1 repository listed
  Speech emotion recognition predicts a speaker's emotional state from speech signals using discrete labels or continuous dimensions such as arousal, valence, and dominance (VAD).
• ABHINAYA -- A System for Speech Emotion Recognition In Naturalistic Conditions Challenge
  23 May 2025 1 repository listed
  Speech emotion recognition (SER) in naturalistic settings remains a challenge due to the intrinsic variability, diverse recording conditions, and class imbalance.
• BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognition
  30 Apr 2025 1 repository listed
  The data was collected on smartphones in the actors homes and therefore includes at least 98 different acoustic environments.
• Large Language Models Meet Contrastive Learning: Zero-Shot Emotion Recognition Across Languages
  25 Mar 2025 1 repository listed
  Multilingual speech emotion recognition aims to estimate a speaker's emotional state using a contactless method across different languages.
• Steering Language Model to Stable Speech Emotion Recognition via Contextual Perception and Chain of Thought
  25 Feb 2025 1 repository listed
  Large-scale audio language models (ALMs), such as Qwen2-Audio, are capable of comprehending diverse audio signal, performing audio analysis and generating textual responses.
• SigWavNet: Learning Multiresolution Signal Wavelet Network for Speech Emotion Recognition
  1 Feb 2025 1 repository listed
  By leveraging the properties of the fast discrete wavelet transform (FDWT), including the cascade algorithm, conjugate quadrature filter, and coefficient denoising, our approach introduces a learnable model for both…
• OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia
  23 Jan 2025 1 repository listed
  Large Language Models (LLMs) have made significant progress in various downstream tasks, inspiring the development of Speech Understanding Language Models (SULMs) to enable comprehensive speech-based interactions.
• Emotional Vietnamese Speech-Based Depression Diagnosis Using Dynamic Attention Mechanism
  11 Dec 2024 1 repository listed
  Major depressive disorder is a prevalent and serious mental health condition that negatively impacts your emotions, thoughts, actions, and overall perception of the world.

Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.