Voice Cloning

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 36 papers with code (112 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis
  12 Jun 2018 11 repositories listed
  Clone a voice in 5 seconds to generate arbitrary speech in real-time
• Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning
  9 Jul 2019 4 repositories listed Syntology ran 2 of 9 samples · 7 unverified · 7 pointer-only (licence)
  We present a multispeaker, multilingual text-to-speech (TTS) synthesis model based on Tacotron that is able to produce high quality speech in multiple languages.
• FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
  4 Jul 2024 3 repositories listed Syntology ran 10 of 10 samples · 0 unverified
  This report introduces FunAudioLLM, a model family designed to enhance natural voice interactions between humans and large language models (LLMs).
• Enhancing Suno's Bark Text-to-Speech Model: Addressing Limitations Through Meta's Encodec and Pre-Trained Hubert
  18 Apr 2023 3 repositories listed
  Keywords: Bark, ai voice cloning, Suno, text-to-speech, artificial intelligence, audio generation, Meta's encodec, audio codebooks, semantic tokens, HuBert, transformer-based model, multilingual speech, wav2vec, linear…
• WavLM model ensemble for audio deepfake detection
  14 Aug 2024 2 repositories listed
  Audio deepfake detection has become a pivotal task over the last couple of years, as many recent speech synthesis and voice cloning systems generate highly realistic speech samples, thus enabling their use in malicious…
• Anonymizing Speech: Evaluating and Designing Speaker Anonymization Techniques
  5 Aug 2023 2 repositories listed
  The growing use of voice user interfaces has led to a surge in the collection and storage of speech data.
• ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-Speech
  7 Nov 2022 2 repositories listed
  In this paper, we extend the pretraining method for cross-lingual multi-speaker speech synthesis tasks, including cross-lingual multi-speaker voice cloning and cross-lingual multi-speaker speech editing.
• Neural Voice Cloning with a Few Samples
  14 Feb 2018 2 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Speaker adaptation is based on fine-tuning a multi-speaker generative model with a few cloning samples.
• Few-Shot Speech Deepfake Detection Adaptation with Gaussian Processes
  29 May 2025 1 repository listed
  Recent advancements in Text-to-Speech (TTS) models, particularly in voice cloning, have intensified the demand for adaptable and efficient deepfake detection methods.
• ClonEval: An Open Voice Cloning Benchmark
  29 Apr 2025 1 repository listed
  We present a novel benchmark for voice cloning text-to-speech models.
• SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Development
  31 Mar 2025 1 repository listed
  High-quality speech dialogue datasets are crucial for Speech-LLM development, yet existing acquisition methods face significant limitations.
• Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
  3 Mar 2025 1 repository listed Syntology ran 1 of 2 samples · 1 unverified
  Recent advancements in large language models (LLMs) have driven significant progress in zero-shot text-to-speech (TTS) synthesis.
• SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generation
  18 Feb 2025 1 repository listed Syntology ran 2 of 2 samples · 0 unverified
  Text-to-song generation, the task of creating vocals and accompaniment from textual inputs, poses significant challenges due to domain complexity and data scarcity.
• Step-Audio: Unified Understanding and Generation in Intelligent Speech Interaction
  17 Feb 2025 1 repository listed
  Based on our new StepEval-Audio-360 evaluation benchmark, Step-Audio achieves state-of-the-art performance in human evaluations, especially in terms of instruction following.
• IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
  8 Feb 2025 1 repository listed
  Recently, large language model (LLM) based text-to-speech (TTS) systems have gradually become the mainstream in the industry due to their high naturalness and powerful zero-shot voice cloning capabilities.
• Lina-Speech: Gated Linear Attention is a Fast and Parameter-Efficient Learner for text-to-speech synthesis
  30 Oct 2024 1 repository listed
  However, this approach is limited in its ability to handle numerous or lengthy speech excerpts, since the concatenation of source and target speech must fall within the maximum context length which is determined during…
• EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control
  1 Oct 2024 1 repository listed
  While recent advances in Text-to-Speech (TTS) technology produce natural and expressive speech, they lack the option for users to select emotion and control intensity.
• LlamaPartialSpoof: An LLM-Driven Fake Speech Dataset Simulating Disinformation Generation
  23 Sep 2024 1 repository listed
  Previous fake speech datasets were constructed from a defender's perspective to develop countermeasure (CM) systems without considering diverse motivations of attackers.
• Is Audio Spoof Detection Robust to Laundering Attacks?
  27 Aug 2024 1 repository listed
  Seven SOTA audio spoof detection approaches are evaluated on this laundered database.
• CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens
  7 Jul 2024 1 repository listed
  Based on the tokens, we further propose a scalable zero-shot TTS synthesizer, CosyVoice, which consists of an LLM for text-to-token generation and a conditional flow matching model for token-to-speech synthesis.
• XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model
  7 Jun 2024 1 repository listed Syntology ran 3 of 6 samples · 3 unverified
  Most Zero-shot Multi-speaker TTS (ZS-TTS) systems support only a single language.
• Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis
  6 Jun 2024 1 repository listed
  Recent advancements in text-to-speech (TTS) powered by language models have showcased remarkable capabilities in achieving naturalness and zero-shot voice cloning.
• PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset
  14 May 2024 1 repository listed
  We conduct comprehensive experiments using state-of-the-art detection methods on PolyGlotFake dataset.
• StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing
  20 Feb 2024 1 repository listed
  Given a script, the challenge in Movie Dubbing (Visual Voice Cloning, V2C) is to generate speech that aligns well with the video in both time and emotion, based on the tone of a reference audio track.
• Proactive Detection of Voice Cloning with Localized Watermarking
  30 Jan 2024 1 repository listed Syntology ran 1 of 3 samples · 2 unverified
  In the rapidly evolving field of speech generative models, there is a pressing need to ensure audio authenticity against the risks of voice cloning.
• OpenVoice: Versatile Instant Voice Cloning
  3 Dec 2023 1 repository listed Syntology ran 3 of 15 samples · 12 unverified
  The voice styles are not directly copied from and constrained by the style of the reference speaker.
• Single and Multi-Speaker Cloned Voice Detection: From Perceptual to Learned Features
  15 Jul 2023 1 repository listed Syntology ran 3 of 4 samples · 1 unverified
  Synthetic-voice cloning technologies have seen significant advances in recent years, giving rise to a range of potential harms.
• Low-Resource Multilingual and Zero-Shot Multispeaker TTS
  21 Oct 2022 1 repository listed
  While neural methods for text-to-speech (TTS) have shown great advances in modeling multiple speakers, even in zero-shot settings, the amount of data needed for those approaches is generally not feasible for the vast…
• Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech Synthesis
  14 Oct 2022 1 repository listed
  We present a comprehensive empirical study for personalized spontaneous speech synthesis on the basis of linguistic knowledge.
• Dictionary Attacks on Speaker Verification
  24 Apr 2022 1 repository listed
  In this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance.

Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.