Audio Synthesis

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 55 papers with code (127 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
  4 Mar 2018 35 repositories listed Syntology ran 2 of 10 samples · 8 unverified · 1 pointer-only (licence)
  Our results indicate that a simple convolutional architecture outperforms canonical recurrent networks such as LSTMs across a diverse range of tasks and datasets, while demonstrating longer effective memory.
• Tacotron: Towards End-to-End Speech Synthesis
  29 Mar 2017 30 repositories listed Syntology ran 7 of 25 samples · 18 unverified · 6 pointer-only (licence)
  A text-to-speech synthesis system typically consists of multiple stages, such as a text analysis frontend, an acoustic model and an audio synthesis module.
• Adversarial Audio Synthesis
  12 Feb 2018 22 repositories listed Syntology ran 2 of 4 samples · 2 unverified · 4 pointer-only (licence)
  Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales.
• Efficient Neural Audio Synthesis
  23 Feb 2018 16 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  The small number of weights in a Sparse WaveRNN makes it possible to sample high-fidelity audio on a mobile CPU in real time.
• DiffWave: A Versatile Diffusion Model for Audio Synthesis
  21 Sep 2020 11 repositories listed Syntology ran 20 of 33 samples · 13 unverified
  In this work, we propose DiffWave, a versatile diffusion probabilistic model for conditional and unconditional waveform generation.
• Differentiable All-pole Filters for Time-varying Audio Systems
  11 Apr 2024 8 repositories listed
  Infinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers.
• Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders
  5 Apr 2017 8 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  Generative models in vision have seen rapid progress due to algorithmic improvements and the availability of high-quality image datasets.
• GANSynth: Adversarial Neural Audio Synthesis
  23 Feb 2019 6 repositories listed
  Efficient audio synthesis is an inherently difficult machine learning task, as human perception is sensitive to both global structure and fine-scale waveform coherence.
• BigVGAN: A Universal Neural Vocoder with Large-Scale Training
  9 Jun 2022 5 repositories listed Syntology ran 8 of 17 samples · 9 unverified · 1 pointer-only (licence)
  Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous…
• CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation
  7 Jul 2021 5 repositories listed Syntology ran 10 of 19 samples · 9 unverified · 1 pointer-only (licence)
  In this paper, we propose Conditional Score-based Diffusion models for Imputation (CSDI), a novel time series imputation method that utilizes score-based diffusion models conditioned on observed data.
• Differentiable Time-Varying Linear Prediction in the Context of End-to-End Analysis-by-Synthesis
  7 Jun 2024 4 repositories listed
  Training the linear prediction (LP) operator end-to-end for audio synthesis in modern deep learning frameworks is slow due to its recursive formulation.
• Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis
  1 Jun 2023 4 repositories listed Syntology ran 5 of 16 samples · 11 unverified
  Recent advancements in neural vocoding are predominantly driven by Generative Adversarial Networks (GANs) operating in the time-domain.
• RAVE: A variational autoencoder for fast and high-quality neural audio synthesis
  9 Nov 2021 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  By leveraging a multi-band decomposition of the raw waveform, we show that our model is the first able to generate 48kHz audio signals, while simultaneously running 20 times faster than real-time on a standard laptop…
• SpeedySpeech: Efficient Neural Speech Synthesis
  9 Aug 2020 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  While recent neural sequence-to-sequence models have greatly improved the quality of speech synthesis, there has not been a system capable of fast training, fast inference and high-quality audio synthesis at the same…
• DDSP: Differentiable Digital Signal Processing
  14 Jan 2020 3 repositories listed Syntology ran 0 of 5 samples · 5 unverified · 5 pointer-only (licence)
  In this paper, we introduce the Differentiable Digital Signal Processing (DDSP) library, which enables direct integration of classic signal processing elements with deep learning methods.
• Deep Voice: Real-time Neural Text-to-Speech
  25 Feb 2017 3 repositories listed Syntology ran 0 of 8 samples · 8 unverified
  We present Deep Voice, a production-quality text-to-speech system constructed entirely from deep neural networks.
• AudioLCM: Text-to-Audio Generation with Latent Consistency Models
  1 Jun 2024 2 repositories listed
  To overcome the convergence issue inherent in LDMs with reduced sample iterations, we propose the Guided Latent Consistency Distillation with a multi-step Ordinary Differential Equation (ODE) solver.
• Fre-GAN: Adversarial Frequency-consistent Audio Synthesis
  4 Jun 2021 2 repositories listed
  Although recent works on neural vocoder have improved the quality of synthesized audio, there still exists a gap between generated and ground-truth audio in frequency space.
• Real-time Timbre Transfer and Sound Synthesis using DDSP
  12 Mar 2021 2 repositories listed
  In this paper, we present a real-time implementation of the DDSP library embedded in a virtual synthesizer as a plug-in that can be used in a Digital Audio Workstation.
• WaveGlow: A Flow-based Generative Network for Speech Synthesis
  31 Oct 2018 2 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  In this paper we propose WaveGlow: a flow-based network capable of generating high quality speech from mel-spectrograms.
• Fast Differentiable Modal Simulation of Non-linear Strings, Membranes, and Plates
  9 May 2025 1 repository listed
  Modal methods for simulating vibrations of strings, membranes, and plates are widely used in acoustics and physically informed audio synthesis.
• Generative diffusion model with inverse renormalization group flows
  15 Jan 2025 1 repository listed
  Here we introduce a renormalization group-based diffusion model that leverages multiscale nature of data distributions for realizing a high-quality data generation.
• MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis
  19 Dec 2024 1 repository listed Syntology ran 0 of 4 samples · 4 unverified
  We propose to synthesize high-quality and synchronized audio, given video and optional text conditions, using a novel multimodal joint training framework MMAudio.
• OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
  2 Dec 2024 1 repository listed Syntology ran 2 of 7 samples · 5 unverified · 7 pointer-only (licence)
  We introduce OmniFlow, a novel generative model designed for any-to-any generation tasks such as text-to-image, text-to-audio, and audio-to-image synthesis.
• Where are we in audio deepfake detection? A systematic analysis over generative and detection models
  6 Oct 2024 1 repository listed
  Through extensive experiments, (1) we reveal the limitations of existing detection methods and demonstrate that foundation models exhibit stronger generalization capabilities, likely due to their model size and the…
• ViolinDiff: Enhancing Expressive Violin Synthesis with Pitch Bend Conditioning
  19 Sep 2024 1 repository listed
  Modeling the natural contour of fundamental frequency (F0) plays a critical role in music audio synthesis.
• LiteFocus: Accelerated Diffusion Inference for Long Audio Synthesis
  15 Jul 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified
  Latent diffusion models have shown promising results in audio generation, making notable advancements over traditional methods.
• Taming Data and Transformers for Audio Generation
  27 Jun 2024 1 repository listed
  The scalability of ambient sound generators is hindered by data scarcity, insufficient caption quality, and limited scalability in model architecture.
• Diffusion-TS: Interpretable Diffusion for General Time Series Generation
  4 Mar 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Denoising diffusion probabilistic models (DDPMs) are becoming the leading paradigm for generative models.
• DiffMoog: a Differentiable Modular Synthesizer for Sound Matching
  23 Jan 2024 1 repository listed
  We introduce an open-source platform that comprises DiffMoog and an end-to-end sound matching framework.

Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.