Text-to-Music Generation

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

6 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

25 shown of 25 papers with code (37 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Simple and Controllable Music Generation
  8 Jun 2023 8 repositories listed Syntology ran 11 of 18 samples · 7 unverified · 7 pointer-only (licence)
  We tackle the task of conditional music generation.
• MusicLM: Generating Music From Text
  26 Jan 2023 5 repositories listed Syntology ran 6 of 16 samples · 10 unverified
  We introduce MusicLM, a model generating high-fidelity music from text descriptions such as "a calming violin melody backed by a distorted guitar riff".
• Mustango: Toward Controllable Text-to-Music Generation
  14 Nov 2023 4 repositories listed Syntology ran 7 of 9 samples · 2 unverified
  Through extensive experiments, we show that the quality of the music generated by Mustango is state-of-the-art, and the controllability through music-specific text prompts greatly outperforms other models such as…
• Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning
  22 Aug 2023 3 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  To fill this gap, we present a methodology for generating question-answer pairs from existing audio captioning datasets and introduce the MusicQA Dataset designed for answering open-ended music-related questions.
• Moûsai: Text-to-Music Generation with Long-Context Latent Diffusion
  27 Jan 2023 3 repositories listed
  Recent years have seen the rapid development of large generative models for text; however, much less research has explored the connection between text and another "language" of communication -- music.
• FLUX that Plays Music
  1 Sep 2024 2 repositories listed Syntology ran 6 of 9 samples · 3 unverified · 9 pointer-only (licence)
  This paper explores a simple extension of diffusion-based rectified flow Transformers for text-to-music generation, termed as FluxMusic.
• MusiConGen: Rhythm and Chord Control for Transformer-Based Text-to-Music Generation
  21 Jul 2024 2 repositories listed
  However, textual prompts alone cannot precisely control temporal musical features such as chords and rhythm of the generated music.
• Quality-aware Masked Diffusion Transformer for Enhanced Music Generation
  24 May 2024 2 repositories listed Syntology ran 4 of 7 samples · 3 unverified
  Text-to-music (TTM) generation, which converts textual descriptions into audio, opens up innovative avenues for multimedia creation.
• Fast Timing-Conditioned Latent Audio Diffusion
  7 Feb 2024 2 repositories listed Syntology ran 2 of 4 samples · 2 unverified
  Generating long-form 44.
• AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining
  10 Aug 2023 2 repositories listed Syntology ran 12 of 27 samples · 15 unverified · 13 pointer-only (licence)
  Any audio can be translated into LOA based on AudioMAE, a self-supervised pre-trained representation learning model.
• JEN-1: Text-Guided Universal Music Generation with Omnidirectional Diffusion Models
  9 Aug 2023 2 repositories listed
  Despite the task's significance, prevailing generative models exhibit limitations in music quality, computational efficiency, and generalization.
• Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task
  21 Nov 2022 2 repositories listed
  Benefiting from large-scale datasets and pre-trained models, the field of generative models has recently gained significant momentum.
• TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrument
  13 Feb 2025 1 repository listed
  Recent advancements in neural audio codecs have enabled the use of tokenized audio representations in various audio generation tasks, such as text-to-speech, text-to-audio, and text-to-music generation.
• ETTA: Elucidating the Design Space of Text-to-Audio Models
  26 Dec 2024 1 repository listed
  Recent years have seen significant progress in Text-To-Audio (TTA) synthesis, enabling users to enrich their creative workflows with synthetic audio generated from natural language prompts.
• Long-Form Text-to-Music Generation with Adaptive Prompts: A Case Study in Tabletop Role-Playing Games Soundtracks
  6 Nov 2024 1 repository listed
  This paper investigates the capabilities of text-to-audio music generation models in producing long-form music with prompts that change over time, focusing on soundtrack generation for Tabletop Role-Playing Games…
• Melody-Guided Music Generation
  30 Sep 2024 1 repository listed
  We present the Melody-Guided Music Generation (MG2) model, a novel approach using melody to guide the text-to-music generation that, despite a simple method and limited resources, achieves excellent performance.
• Stable Audio Open
  19 Jul 2024 1 repository listed Syntology ran 1 of 2 samples · 1 unverified
  Open generative models are vitally important for the community, allowing for fine-tunes and serving as baselines when presenting new models.
• Improving Text-To-Audio Models with Synthetic Captions
  18 Jun 2024 1 repository listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  It is an open challenge to obtain high quality training data, especially captions, for text-to-audio models.
• MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models
  7 Jun 2024 1 repository listed Syntology ran 12 of 12 samples · 0 unverified · 12 pointer-only (licence)
  MeLFusion is a text-to-music diffusion model with a novel "visual synapse", which effectively infuses the semantics from the visual modality into the generated music.
• MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models
  9 Feb 2024 1 repository listed Syntology ran 0 of 1 samples · 1 unverified
  This paper introduces a novel approach to the editing of music generated by such models, enabling the modification of specific attributes, such as genre, mood and instrument, while maintaining other aspects unchanged.
• PAM: Prompting Audio-Language Models for Audio Quality Assessment
  1 Feb 2024 1 repository listed Syntology ran 8 of 10 samples · 2 unverified
  Here, we exploit this capability and introduce PAM, a no-reference metric for assessing audio quality for different audio processing tasks.
• The Song Describer Dataset: a Corpus of Audio Captions for Music-and-Language Evaluation
  16 Nov 2023 1 repository listed Syntology ran 3 of 3 samples · 0 unverified
  We introduce the Song Describer dataset (SDD), a new crowdsourced corpus of high-quality audio-caption pairs, designed for the evaluation of music-and-language models.
• Music ControlNet: A model similar to SD ControlNetD that can accurately control music generation
  7 Nov 2023 1 repository listed
  While the image-domain Uni-ControlNet method already allows generation with any subset of controls, we devise a new strategy to allow creators to input controls that are only partially specified in time.
• Investigating Personalization Methods in Text to Music Generation
  20 Sep 2023 1 repository listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  In this work, we investigate the personalization of text-to-music diffusion models in a few-shot setting.
• MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies
  3 Aug 2023 1 repository listed Syntology ran 9 of 14 samples · 5 unverified · 14 pointer-only (licence)
  Diffusion models have shown promising results in cross-modal generation tasks, including text-to-image and text-to-audio generation.

Syntology lines on 16 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.