{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/contrastive-unsupervised-learning-for-speech","title":"Contrastive Unsupervised Learning for Speech Emotion Recognition","arxiv_id":"2102.06357","date":"2021-02-12","proceeding":null,"authors":["Mao Li","Bo Yang","Joshua Levy","Andreas Stolcke","Viktor Rozgic","Spyros Matsoukas","Constantinos Papayiannis","Daniel Bone","Chao Wang"],"abstract":"Speech emotion recognition (SER) is a key technology to enable more natural human-machine communication. However, SER has long suffered from a lack of public large-scale labeled datasets. To circumvent this problem, we investigate how unsupervised representation learning on unlabeled datasets can benefit SER. We show that the contrastive predictive coding (CPC) method can learn salient representations from unlabeled datasets, which improves emotion recognition performance. In our experiments, this method achieved state-of-the-art concordance correlation coefficient (CCC) performance for all emotion primitives (activation, valence, and dominance) on IEMOCAP. Additionally, on the MSP- Podcast dataset, our method obtained considerable performance improvements compared to baselines.","url_abs":"https://arxiv.org/abs/2102.06357v1","url_pdf":"https://arxiv.org/pdf/2102.06357v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"emotion-recognition","task_name":"Emotion Recognition"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"speech-emotion-recognition","task_name":"Speech Emotion Recognition"}],"methods":[{"method_slug":"contrastive-predictive-coding","method_name":"Contrastive Predictive Coding"},{"method_slug":"infonce","method_name":"InfoNCE"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/speech-emotion-recognition-on-msp-podcast-1","task":"Speech Emotion Recognition","dataset":"MSP-Podcast (Activation)","model":"preCPC","rank_in_archive_order":4,"of":4,"metrics":{"CCC":"0.706"},"uses_additional_data":true},{"leaderboard":"/sota/speech-emotion-recognition-on-msp-podcast-2","task":"Speech Emotion Recognition","dataset":"MSP-Podcast (Dominance)","model":"preCPC","rank_in_archive_order":4,"of":4,"metrics":{"CCC":"0.639"},"uses_additional_data":true},{"leaderboard":"/sota/speech-emotion-recognition-on-msp-podcast","task":"Speech Emotion Recognition","dataset":"MSP-Podcast (Valence)","model":"preCPC","rank_in_archive_order":4,"of":4,"metrics":{"CCC":"0.377"},"uses_additional_data":true}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}