Browse State-of-the-Art › Audio Synthesis
Audio Synthesis
55 papers with code · 0 benchmarks · 2 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 127 · with a code link: 55 · where Syntology ran a sample: 24 (18 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (24 of 127 tagged: 18 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 127, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
4 Mar 2018 35 repositories listed Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 1 pointer-only (licence)Our results indicate that a simple convolutional architecture outperforms canonical recurrent networks such as LSTMs across a diverse range of tasks and datasets, while demonstrating longer effective memory.
-
29 Mar 2017 30 repositories listed Syntology 16 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 3 honoured, 1 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 9 unverified (of 25 harvested samples) · 6 pointer-only (licence)A text-to-speech synthesis system typically consists of multiple stages, such as a text analysis frontend, an acoustic model and an audio synthesis module.
-
12 Feb 2018 22 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales.
-
23 Feb 2018 16 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)The small number of weights in a Sparse WaveRNN makes it possible to sample high-fidelity audio on a mobile CPU in real time.
-
21 Sep 2020 11 repositories listed Syntology 20 ran (of which 11 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 7 where Syntology's instrument failed) · 13 unverified (of 33 harvested samples)In this work, we propose DiffWave, a versatile diffusion probabilistic model for conditional and unconditional waveform generation.
-
11 Apr 2024 8 repositories listedInfinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers.
-
5 Apr 2017 8 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)Generative models in vision have seen rapid progress due to algorithmic improvements and the availability of high-quality image datasets.
-
23 Feb 2019 6 repositories listedEfficient audio synthesis is an inherently difficult machine learning task, as human perception is sensitive to both global structure and fine-scale waveform coherence.
-
9 Jun 2022 5 repositories listed Syntology community repositories only · 15 ran (of which 2 constructed an object rather than computing a result; 12 with no instrument failure: 3 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples) · 9 pointer-only (licence)Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous…
-
7 Jul 2021 5 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 12 ran (of which 4 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified (of 19 harvested samples) · 3 pointer-only (licence)In this paper, we propose Conditional Score-based Diffusion models for Imputation (CSDI), a novel time series imputation method that utilizes score-based diffusion models conditioned on observed data.
-
7 Jun 2024 4 repositories listedTraining the linear prediction (LP) operator end-to-end for audio synthesis in modern deep learning frameworks is slow due to its recursive formulation.
-
1 Jun 2023 4 repositories listed Syntology official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 16 harvested samples) · 1 pointer-only (licence)Recent advancements in neural vocoding are predominantly driven by Generative Adversarial Networks (GANs) operating in the time-domain.
-
9 Nov 2021 3 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)By leveraging a multi-band decomposition of the raw waveform, we show that our model is the first able to generate 48kHz audio signals, while simultaneously running 20 times faster than real-time on a standard laptop…
-
9 Aug 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)While recent neural sequence-to-sequence models have greatly improved the quality of speech synthesis, there has not been a system capable of fast training, fast inference and high-quality audio synthesis at the same…
-
14 Jan 2020 3 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)In this paper, we introduce the Differentiable Digital Signal Processing (DDSP) library, which enables direct integration of classic signal processing elements with deep learning methods.
-
25 Feb 2017 3 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)We present Deep Voice, a production-quality text-to-speech system constructed entirely from deep neural networks.
-
1 Jun 2024 2 repositories listedTo overcome the convergence issue inherent in LDMs with reduced sample iterations, we propose the Guided Latent Consistency Distillation with a multi-step Ordinary Differential Equation (ODE) solver.
-
4 Jun 2021 2 repositories listedAlthough recent works on neural vocoder have improved the quality of synthesized audio, there still exists a gap between generated and ground-truth audio in frequency space.
-
12 Mar 2021 2 repositories listedIn this paper, we present a real-time implementation of the DDSP library embedded in a virtual synthesizer as a plug-in that can be used in a Digital Audio Workstation.
-
31 Oct 2018 2 repositories listed Syntology 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 2 pointer-only (licence)In this paper we propose WaveGlow: a flow-based network capable of generating high quality speech from mel-spectrograms.
-
9 May 2025 1 repository listedModal methods for simulating vibrations of strings, membranes, and plates are widely used in acoustics and physically informed audio synthesis.
-
15 Jan 2025 1 repository listedHere we introduce a renormalization group-based diffusion model that leverages multiscale nature of data distributions for realizing a high-quality data generation.
-
19 Dec 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)We propose to synthesize high-quality and synchronized audio, given video and optional text conditions, using a novel multimodal joint training framework MMAudio.
-
2 Dec 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 7 pointer-only (licence)We introduce OmniFlow, a novel generative model designed for any-to-any generation tasks such as text-to-image, text-to-audio, and audio-to-image synthesis.
-
Where are we in audio deepfake detection? A systematic analysis over generative and detection models6 Oct 2024 1 repository listedThrough extensive experiments, (1) we reveal the limitations of existing detection methods and demonstrate that foundation models exhibit stronger generalization capabilities, likely due to their model size and the…
-
19 Sep 2024 1 repository listedModeling the natural contour of fundamental frequency (F0) plays a critical role in music audio synthesis.
-
15 Jul 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Latent diffusion models have shown promising results in audio generation, making notable advancements over traditional methods.
-
27 Jun 2024 1 repository listedThe scalability of ambient sound generators is hindered by data scarcity, insufficient caption quality, and limited scalability in model architecture.
-
4 Mar 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Denoising diffusion probabilistic models (DDPMs) are becoming the leading paradigm for generative models.
-
23 Jan 2024 1 repository listedWe introduce an open-source platform that comprises DiffMoog and an end-to-end sound matching framework.
-
17 Jan 2024 1 repository listed
-
13 Dec 2023 1 repository listed
-
29 Jun 2023 1 repository listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
27 Feb 2023 1 repository listed
-
7 Jan 2023 1 repository listed
-
13 Dec 2022 1 repository listed
-
17 Sep 2022 1 repository listed
-
13 Jun 2022 1 repository listed
-
30 May 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
17 Dec 2021 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
19 Nov 2021 1 repository listed
-
9 Nov 2021 1 repository listed
-
11 Jul 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
4 May 2021 1 repository listed
-
26 Apr 2021 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
27 Oct 2020 1 repository listed
-
27 Aug 2020 1 repository listed
-
23 Jun 2020 1 repository listed
-
16 Jun 2020 1 repository listed
-
31 May 2020 1 repository listed
-
30 Mar 2020 1 repository listed
-
27 Nov 2019 1 repository listed
-
29 Oct 2019 1 repository listed
-
11 Feb 2019 1 repository listed
-
23 Oct 2018 1 repository listed
-
MIDI-VALLE: Improving Expressive Piano Performance Synthesis Through Neural Codec Language Modelling11 Jul 2025 0 repositories listed
-
Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance26 Jun 2025 0 repositories listed
-
Diffusion-Based Symbolic Regression30 May 2025 0 repositories listed
-
SpecMaskFoley: Steering Pretrained Spectral Masked Generative Transformer Toward Synchronized Video-to-audio Synthesis via ControlNet22 May 2025 0 repositories listed
-
Communication-Efficient Diffusion Denoising Parallelization via Reuse-then-Predict Mechanism20 May 2025 0 repositories listed
-
DPN-GAN: Inducing Periodic Activations in Generative Adversarial Networks for High-Fidelity Audio Synthesis14 May 2025 0 repositories listed
-
Supervising 3D Talking Head Avatars with Analysis-by-Audio-Synthesis18 Apr 2025 0 repositories listed
-
TARO: Timestep-Adaptive Representation Alignment with Onset-Aware Conditioning for Synchronized Video-to-Audio Synthesis8 Apr 2025 0 repositories listed
-
Designing Neural Synthesizers for Low-Latency Interaction14 Mar 2025 0 repositories listed
-
Long-Video Audio Synthesis with Multi-Agent Collaboration13 Mar 2025 0 repositories listed
-
Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision26 Feb 2025 0 repositories listed
-
XAttnMark: Learning Robust Audio Watermarking with Cross-Attention6 Feb 2025 0 repositories listed
-
Customized Condition Controllable Generation for Video Soundtrack1 Jan 2025 0 repositories listed
-
Tri-Ergon: Fine-grained Video-to-Audio Generation with Multi-modal Conditions and LUFS Control29 Dec 2024 0 repositories listed
-
CSSinger: End-to-End Chunkwise Streaming Singing Voice Synthesis System Based on Conditional Variational Autoencoder12 Dec 2024 0 repositories listed
-
Zero-Shot Mono-to-Binaural Speech Synthesis11 Dec 2024 0 repositories listed
-
Generalized Diffusion Model with Adjusted Offset Noise4 Dec 2024 0 repositories listed
-
VQalAttent: a Transparent Speech Generation Pipeline based on Transformer-learned VQ-VAE Latent Space22 Nov 2024 0 repositories listed
-
Annotation-Free MIDI-to-Audio Synthesis via Concatenative Synthesis and Generative Refinement22 Oct 2024 0 repositories listed
-
Array2BR: An End-to-End Noise-immune Binaural Audio Synthesis from Microphone-array Signals8 Oct 2024 0 repositories listed
-
PTQ4ADM: Post-Training Quantization for Efficient Text Conditional Audio Diffusion Models20 Sep 2024 0 repositories listed
-
D-CAPTCHA++: A Study of Resilience of Deepfake CAPTCHA under Transferable Imperceptible Adversarial Attack11 Sep 2024 0 repositories listed
-
Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis10 Sep 2024 0 repositories listed
-
Fast, High-Quality and Parameter-Efficient Articulatory Synthesis using Differentiable DSP4 Sep 2024 0 repositories listed
-
Hierarchical Generative Modeling of Melodic Vocal Contours in Hindustani Classical Music22 Aug 2024 0 repositories listed
-
Video-Foley: Two-Stage Video-To-Sound Generation via Temporal Event Condition For Foley Sound21 Aug 2024 0 repositories listed
-
EgoSonics: Generating Synchronized Audio for Silent Egocentric Videos30 Jul 2024 0 repositories listed
-
Braille-to-Speech Generator: Audio Generation Based on Joint Fine-Tuning of CLIP and Fastspeech219 Jul 2024 0 repositories listed
-
GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis15 Jul 2024 0 repositories listed
-
AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis13 Jun 2024 0 repositories listed
-
CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems11 Jun 2024 0 repositories listed
-
Creative Text-to-Audio Generation via Synthesizer Programming1 Jun 2024 0 repositories listed
-
Fill in the Gap! Combining Self-supervised Representation Learning with Neural Audio Synthesis for Speech Inpainting30 May 2024 0 repositories listed
-
Text2Data: Low-Resource Data Generation with Textual Control8 Feb 2024 0 repositories listed
-
Fast Diffusion GAN Model for Symbolic Music Generation Controlled by Emotions21 Oct 2023 0 repositories listed
-
8 Oct 2023 0 repositories listed
-
Speech Audio Synthesis from Tagged MRI and Non-Negative Matrix Factorization via Plastic Transformer26 Sep 2023 0 repositories listed
-
DDSP-SFX: Acoustically-guided sound effects generation with differentiable digital signal processing14 Sep 2023 0 repositories listed
-
SnakeGAN: A Universal Vocoder Leveraging DDSP Prior Knowledge and Periodic Inductive Bias14 Sep 2023 0 repositories listed
-
CLIPSonic: Text-to-Audio Synthesis with Unlabeled Videos and Pretrained Language-Vision Models16 Jun 2023 0 repositories listed
-
ECGAN: Self-supervised generative adversarial network for electrocardiography23 Jan 2023 0 repositories listed
-
DopplerBAS: Binaural Audio Synthesis Addressing Doppler Effect14 Dec 2022 0 repositories listed
-
Conditional variational autoencoder to improve neural audio synthesis for polyphonic music sound16 Nov 2022 0 repositories listed
-
Anisotropic multiresolution analyses for deepfake detection26 Oct 2022 0 repositories listed
-
Full-band General Audio Synthesis with Score-based Diffusion26 Oct 2022 0 repositories listed
Syntology lines on 23 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections