Browse State-of-the-Art › Voice Cloning
Voice Cloning
36 papers with code · 0 benchmarks · 2 datasets archive 2025-07-28
Voice cloning is a highly desired feature for personalized speech interfaces. Neural voice cloning system learns to synthesize a person’s voice from only a few audio samples.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 112 · with a code link: 36 · where Syntology ran a sample: 11 (11 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (11 of 112 tagged: 11 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 112, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
12 Jun 2018 11 repositories listedClone a voice in 5 seconds to generate arbitrary speech in real-time
-
9 Jul 2019 4 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 7 pointer-only (licence)We present a multispeaker, multilingual text-to-speech (TTS) synthesis model based on Tacotron that is able to produce high quality speech in multiple languages.
-
4 Jul 2024 3 repositories listed Syntology official (archive's flag): 9 ran · 10 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples)This report introduces FunAudioLLM, a model family designed to enhance natural voice interactions between humans and large language models (LLMs).
-
18 Apr 2023 3 repositories listedKeywords: Bark, ai voice cloning, Suno, text-to-speech, artificial intelligence, audio generation, Meta's encodec, audio codebooks, semantic tokens, HuBert, transformer-based model, multilingual speech, wav2vec, linear…
-
14 Aug 2024 2 repositories listedAudio deepfake detection has become a pivotal task over the last couple of years, as many recent speech synthesis and voice cloning systems generate highly realistic speech samples, thus enabling their use in malicious…
-
5 Aug 2023 2 repositories listedThe growing use of voice user interfaces has led to a surge in the collection and storage of speech data.
-
7 Nov 2022 2 repositories listedIn this paper, we extend the pretraining method for cross-lingual multi-speaker speech synthesis tasks, including cross-lingual multi-speaker voice cloning and cross-lingual multi-speaker speech editing.
-
14 Feb 2018 2 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)Speaker adaptation is based on fine-tuning a multi-speaker generative model with a few cloning samples.
-
29 May 2025 1 repository listedRecent advancements in Text-to-Speech (TTS) models, particularly in voice cloning, have intensified the demand for adaptable and efficient deepfake detection methods.
-
29 Apr 2025 1 repository listedWe present a novel benchmark for voice cloning text-to-speech models.
-
31 Mar 2025 1 repository listedHigh-quality speech dialogue datasets are crucial for Speech-LLM development, yet existing acquisition methods face significant limitations.
-
3 Mar 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Recent advancements in large language models (LLMs) have driven significant progress in zero-shot text-to-speech (TTS) synthesis.
-
18 Feb 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Text-to-song generation, the task of creating vocals and accompaniment from textual inputs, poses significant challenges due to domain complexity and data scarcity.
-
17 Feb 2025 1 repository listedBased on our new StepEval-Audio-360 evaluation benchmark, Step-Audio achieves state-of-the-art performance in human evaluations, especially in terms of instruction following.
-
8 Feb 2025 1 repository listedRecently, large language model (LLM) based text-to-speech (TTS) systems have gradually become the mainstream in the industry due to their high naturalness and powerful zero-shot voice cloning capabilities.
-
30 Oct 2024 1 repository listedHowever, this approach is limited in its ability to handle numerous or lengthy speech excerpts, since the concatenation of source and target speech must fall within the maximum context length which is determined during…
-
1 Oct 2024 1 repository listedWhile recent advances in Text-to-Speech (TTS) technology produce natural and expressive speech, they lack the option for users to select emotion and control intensity.
-
23 Sep 2024 1 repository listedPrevious fake speech datasets were constructed from a defender's perspective to develop countermeasure (CM) systems without considering diverse motivations of attackers.
-
27 Aug 2024 1 repository listedSeven SOTA audio spoof detection approaches are evaluated on this laundered database.
-
7 Jul 2024 1 repository listedBased on the tokens, we further propose a scalable zero-shot TTS synthesizer, CosyVoice, which consists of an LLM for text-to-token generation and a conditional flow matching model for token-to-speech synthesis.
-
7 Jun 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)Most Zero-shot Multi-speaker TTS (ZS-TTS) systems support only a single language.
-
6 Jun 2024 1 repository listedRecent advancements in text-to-speech (TTS) powered by language models have showcased remarkable capabilities in achieving naturalness and zero-shot voice cloning.
-
14 May 2024 1 repository listedWe conduct comprehensive experiments using state-of-the-art detection methods on PolyGlotFake dataset.
-
20 Feb 2024 1 repository listedGiven a script, the challenge in Movie Dubbing (Visual Voice Cloning, V2C) is to generate speech that aligns well with the video in both time and emotion, based on the tone of a reference audio track.
-
30 Jan 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result (of 3 harvested samples)In the rapidly evolving field of speech generative models, there is a pressing need to ensure audio authenticity against the risks of voice cloning.
-
3 Dec 2023 1 repository listed Syntology 13 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples) · 5 pointer-only (licence)The voice styles are not directly copied from and constrained by the style of the reference speaker.
-
15 Jul 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)Synthetic-voice cloning technologies have seen significant advances in recent years, giving rise to a range of potential harms.
-
21 Oct 2022 1 repository listedWhile neural methods for text-to-speech (TTS) have shown great advances in modeling multiple speakers, even in zero-shot settings, the amount of data needed for those approaches is generally not feasible for the vast…
-
14 Oct 2022 1 repository listedWe present a comprehensive empirical study for personalized spontaneous speech synthesis on the basis of linguistic knowledge.
-
24 Apr 2022 1 repository listedIn this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance.
-
6 Nov 2021 1 repository listed
-
12 Oct 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
26 Jun 2021 1 repository listed
-
22 Apr 2021 1 repository listed
-
6 Mar 2021 1 repository listed
-
3 Aug 2020 1 repository listed
-
Pronunciation Deviation Analysis Through Voice Cloning and Acoustic Comparison15 Jul 2025 0 repositories listed
-
De-AntiFake: Rethinking the Protective Perturbations Against Voice Cloning Attacks3 Jul 2025 0 repositories listed
-
Voice Adaptation for Swiss German28 May 2025 0 repositories listed
-
Phir Hera Fairy: An English Fairytaler is a Strong Faker of Fluent Speech in Low-Resource Indian Languages27 May 2025 0 repositories listed
-
VoiceMark: Zero-Shot Voice Cloning-Resistant Watermarking Approach Leveraging Speaker-Specific Latents27 May 2025 0 repositories listed
-
CloneShield: A Framework for Universal Perturbation Against Zero-Shot Voice Cloning25 May 2025 0 repositories listed
-
Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection22 May 2025 0 repositories listed
-
MIKU-PAL: An Automated and Standardized Multi-Modal Method for Speech Paralinguistic and Affect Labeling21 May 2025 0 repositories listed
-
VoiceCloak: A Multi-Dimensional Defense Framework against Unauthorized Diffusion-based Voice Cloning18 May 2025 0 repositories listed
-
MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encoder12 May 2025 0 repositories listed
-
Voice Cloning: Comprehensive Survey1 May 2025 0 repositories listed
-
"It's not a representation of me": Examining Accent Bias and Digital Exclusion in Synthetic AI Voice Services12 Apr 2025 0 repositories listed
-
Empowering Global Voices: A Data-Efficient, Phoneme-Tone Adaptive Approach to High-Fidelity Speech Synthesis10 Apr 2025 0 repositories listed
-
SoK: How Robust is Audio Watermarking in Generative AI models?24 Mar 2025 0 repositories listed
-
Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology3 Mar 2025 0 repositories listed
-
Steganography Beyond Space-Time with Chain of Multimodal AI25 Feb 2025 0 repositories listed
-
Deepfake Technology Unveiled: The Commoditization of AI and Its Impact on Digital Trust24 Jan 2025 0 repositories listed
-
Towards Lightweight and Stable Zero-shot TTS with Self-distilled Representation Disentanglement15 Jan 2025 0 repositories listed
-
MARS6: A Small and Robust Hierarchical-Codec Text-to-Speech Model10 Jan 2025 0 repositories listed
-
Advancing NAM-to-Speech Conversion with Novel Methods and the MultiNAM Dataset25 Dec 2024 0 repositories listed
-
Speech Watermarking with Discrete Intermediate Representations18 Dec 2024 0 repositories listed
-
Parallel Stacked Aggregated Network for Voice Authentication in IoT-Enabled Smart Devices29 Nov 2024 0 repositories listed
-
Hindi audio-video-Deepfake (HAV-DF): A Hindi language-based Audio-video Deepfake Dataset23 Nov 2024 0 repositories listed
-
The ISCSLP 2024 Conversational Voice Clone (CoVoC) Challenge: Tasks, Results and Findings31 Oct 2024 0 repositories listed
-
DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis14 Oct 2024 0 repositories listed
-
Can DeepFake Speech be Reliably Detected?9 Oct 2024 0 repositories listed
-
Algorithms For Automatic Accentuation And Transcription Of Russian Texts In Speech Recognition Systems3 Oct 2024 0 repositories listed
-
Augmentation through Laundering Attacks for Audio Spoof Detection1 Oct 2024 0 repositories listed
-
Enhancing Synthetic Training Data for Speech Commands: From ASR-Based Filtering to Domain Adaptation in SSL Latent Space19 Sep 2024 0 repositories listed
-
Multi-modal Adversarial Training for Zero-Shot Voice Cloning28 Aug 2024 0 repositories listed
-
kNN Retrieval for Simple and Effective Zero-Shot Multi-speaker Text-to-Speech20 Aug 2024 0 repositories listed
-
Advancing Voice Cloning for Nepali: Leveraging Transfer Learning in a Low-Resource Language19 Aug 2024 0 repositories listed
-
Preset-Voice Matching for Privacy Regulated Speech-to-Speech Translation Systems18 Jul 2024 0 repositories listed
-
A multi-speaker multi-lingual voice cloning system based on vits2 for limmits 2024 challenge22 Jun 2024 0 repositories listed
-
DubWise: Video-Guided Speech Duration Control in Multimodal LLM-based Text-to-Speech for Dubbing13 Jun 2024 0 repositories listed
-
Just Because We Camp, Doesn't Mean We Should: The Ethics of Modelling Queer Voices11 Jun 2024 0 repositories listed
-
Spoken Language Corpora Augmentation with Domain-Specific Voice-Cloned Speech11 Jun 2024 0 repositories listed
-
Non-autoregressive real-time Accent Conversion model with voice cloning21 May 2024 0 repositories listed
-
Scaling NVIDIA's Multi-speaker Multi-lingual TTS Systems with Zero-Shot TTS to Indic Languages24 Jan 2024 0 repositories listed
-
Empowering Communication: Speech Technology for Indian and Western Accents through AI-powered Speech Synthesis22 Jan 2024 0 repositories listed
-
MemoryCompanion: A Smart Healthcare Solution to Empower Efficient Alzheimer's Care Via Unleashing Generative AI20 Nov 2023 0 repositories listed
-
Learning Through AI-Clones: Enhancing Self-Perception and Presentation Performance23 Oct 2023 0 repositories listed
-
High-Fidelity Speech Synthesis with Minimal Supervision: All Using Diffusion Models27 Sep 2023 0 repositories listed
-
Collaborative Watermarking for Adversarial Speech Synthesis26 Sep 2023 0 repositories listed
-
TRAVID: An End-to-End Video Translation Framework20 Sep 2023 0 repositories listed
-
24 Aug 2023 0 repositories listed
-
Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis14 Jul 2023 0 repositories listed
-
Taiwanese-Accented Mandarin and English Multi-Speaker Talking-Face Synthesis System1 Nov 2022 0 repositories listed
-
Mix and Match: An Empirical Study on Training Corpus Composition for Polyglot Text-To-Speech (TTS)4 Jul 2022 0 repositories listed
-
Unsupervised TTS Acoustic Modeling for TTS with Conditional Disentangled Sequential VAE6 Jun 2022 0 repositories listed
-
Self-supervised learning for robust voice cloning7 Apr 2022 0 repositories listed
-
Improve few-shot voice cloning using multi-modal learning18 Mar 2022 0 repositories listed
-
Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention25 Jan 2022 0 repositories listed
-
V2C: Visual Voice Cloning25 Nov 2021 0 repositories listed
-
Meta-Voice: Fast few-shot style transfer for expressive voice cloning using meta learning14 Nov 2021 0 repositories listed
-
Exploring Timbre Disentanglement in Non-Autoregressive Cross-Lingual Text-to-Speech14 Oct 2021 0 repositories listed
-
Improve Cross-lingual Voice Cloning Using Low-quality Code-switched Data14 Oct 2021 0 repositories listed
-
Revisiting IPA-based Cross-lingual Text-to-speech14 Oct 2021 0 repositories listed
-
Adapting TTS models For New Speakers using Transfer Learning12 Oct 2021 0 repositories listed
-
Translatotron 2: High-quality direct speech-to-speech translation with voice preservation19 Jul 2021 0 repositories listed
-
AI based Presentation Creator With Customized Audio Content Delivery27 Jun 2021 0 repositories listed
-
Preliminary study on using vector quantization latent spaces for TTS/VC systems with consistent performance25 Jun 2021 0 repositories listed
-
The AS-NU System for the M2VoC Challenge7 Apr 2021 0 repositories listed
Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections