</> Code with Papers by Syntology

Home › Datasets › task › Audio Generation

Audio Generation datasets

archive 2025-07-28

11 datasets carry the task tag "Audio Generation" (the task itself: Audio Generation), ordered by the archive's paper count. Page 1 of 1: 11 shown of 11. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

All 12,172 Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Audio Generation 11

Audio Generation datasets 1–11 of 11

AudioCaps
AudioCaps is a dataset of sounds with event descriptions that was introduced for the task of audio captioning, with sounds sourced from the AudioSet dataset.
TextsAudioAudio GenerationAudio captioningText to Audio RetrievalAudio to Text RetrievalTarget Sound ExtractionZero-shot Text to Audio Retrieval+5 tasks
279 papers · 6 benchmarks
NSynth
NSynth is a dataset of one shot instrumental notes, containing 305,979 musical notes with unique pitch, timbre and envelope.
AudioSelf-Supervised LearningFew-Shot Audio ClassificationAudio GenerationInstrument RecognitionMusic GenerationPitch Classification
138 papers · 2 benchmarks
MAESTRO
The MAESTRO dataset contains over 200 hours of paired audio and MIDI recordings from ten years of International Piano-e-Competition.
AudioInteractiveMidiMusicAudio GenerationMusic TranscriptionMusic Generation
118 papers · 1 benchmark
MovieNet
MovieNet is a holistic dataset for movie understanding.
VideosVideo UnderstandingScene SegmentationAudio GenerationPerson Search
54 papers · 1 benchmark
SymphonyNet
First large-scale symphony generation dataset.
MidiMusicAudio Generation
10 papers · 1 benchmark
NES-MDB (Nintendo Entertainment System Music Database)
The Nintendo Entertainment System Music Database (NES-MDB) is a dataset intended for building automatic music composition systems for the NES audio synthesizer.
AudioAudio GenerationMusic Generation
7 papers · 0 benchmarks
ADL Piano MIDI
The ADL Piano MIDI is a dataset of 11,086 piano pieces from different genres.
MidiSpeech RecognitionAudio GenerationMusic Generation
5 papers · 0 benchmarks
Blizzard Challenge 2013 (Blizzard Challenge 2013 - English language tasks)
The English data for voice building was obtained, prepared and provided the the challenge by Lessac Technologies Inc., having originally came from the publishers Voice Factory International Inc.
AudioSpeech SynthesisAudio Generation
5 papers · 1 benchmark
dMelodies
dMelodies is dataset of simple 2-bar melodies generated using 9 independent latent factors of variation where each data point represents a unique melody based on the following constraints: - Each melody will correspond to a unique scale…
AudioAudio GenerationMusic Generation
4 papers · 0 benchmarks
Audio-alpaca
Audio-alpaca: A preference dataset for aligning text-to-audio models Audio-alpaca is a pairwise preference dataset containing about 15k (prompt,chosen, rejected) triplets where given a textual prompt, chosen is the preferred generated…
TextsAudioAudio Generation
2 papers · 0 benchmarks
MediBeng (Synthetic Code-Switched Bengali-English Speech Conversations for Healthcare Applications)
MediBeng Dataset The MediBeng dataset contains synthetic code-switched dialogues in Bengali and English for training models in speech recognition (ASR), text-to-speech (TTS), and machine translation in clinical settings.
TextsAudioMedicalSpeechSpeech RecognitionAutomatic Speech RecognitionAudio ClassificationSpeech-to-Text TranslationAudio GenerationSynthetic Data Generation+1 tasks
1 paper · 1 benchmark

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.