{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ancogen-analysis-control-and-generation-of","title":"AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder","arxiv_id":"2501.05332","date":"2025-01-09","proceeding":null,"authors":["Samir Sadok","Simon Leglaive","Laurent Girin","Gaël Richard","Xavier Alameda-Pineda"],"abstract":"This article introduces AnCoGen, a novel method that leverages a masked autoencoder to unify the analysis, control, and generation of speech signals within a single model. AnCoGen can analyze speech by estimating key attributes, such as speaker identity, pitch, content, loudness, signal-to-noise ratio, and clarity index. In addition, it can generate speech from these attributes and allow precise control of the synthesized speech by modifying them. Extensive experiments demonstrated the effectiveness of AnCoGen across speech analysis-resynthesis, pitch estimation, pitch modification, and speech enhancement.","url_abs":"https://arxiv.org/abs/2501.05332v1","url_pdf":"https://arxiv.org/pdf/2501.05332v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ancogen-analysis-control-and-generation-of","repo_url":"https://github.com/samsad35/code-ancogen","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"pitch-classification","task_name":"Pitch Classification"},{"task_slug":"pitch-control","task_name":"Pitch control"},{"task_slug":"resynthesis","task_name":"Resynthesis"},{"task_slug":"speech-enhancement","task_name":"Speech Enhancement"},{"task_slug":"speech-synthesis","task_name":"Speech Synthesis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}