Zero-shot Audio Classification

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

9 shown of 9 papers with code (18 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  3 Oct 2023 6 repositories listed Syntology ran 7 of 14 samples · 7 unverified
  We thus propose VIDAL-10M with Video, Infrared, Depth, Audio and their corresponding Language, naming as VIDAL-10M.
• ImageBind: One Embedding Space To Bind Them All
  9 May 2023 3 repositories listed Syntology ran 24 of 34 samples · 10 unverified · 32 pointer-only (licence)
  We show that all combinations of paired data are not necessary to train such a joint embedding, and only image-paired data is sufficient to bind the modalities together.
• WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research
  30 Mar 2023 3 repositories listed Syntology ran 0 of 12 samples · 12 unverified
  To address this data scarcity issue, we introduce WavCaps, the first large-scale weakly-labelled audio captioning dataset, comprising approximately 400k audio clips with paired captions.
• ReCLAP: Improving Zero Shot Audio Classification by Describing Sounds
  13 Sep 2024 1 repository listed
  To achieve this, we first propose ReCLAP, a CLAP model trained with rewritten audio captions for improved understanding of sounds in the wild.
• Enhancing Audio-Language Models through Self-Supervised Post-Training with Text-Audio Pairs
  17 Aug 2024 1 repository listed
  In this paper, we propose to equip the multi-modal ALMs with temporal understanding without loosing their inherent prior capabilities of audio-language tasks with a temporal instillation method TeminAL.
• Investigating the Emergent Audio Classification Ability of ASR Foundation Models
  15 Nov 2023 1 repository listed
  Text and vision foundation models can perform many tasks in a zero-shot setting, a desirable property that enables these systems to be applied in general and low-resource settings.
• Exploring Meta Information for Audio-based Zero-shot Bird Classification
  15 Sep 2023 1 repository listed
  Advances in passive acoustic monitoring and machine learning have led to the procurement of vast datasets for computational bioacoustic research.
• Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfer
  16 Dec 2021 1 repository listed
  In a difficult zero-shot setting with no paired audio-text data, our model demonstrates state-of-the-art zero-shot performance on the ESC50 and US8K audio classification tasks, and even surpasses the supervised state of…
• Sound-Guided Semantic Image Manipulation
  30 Nov 2021 1 repository listed
  Our audio encoder is trained to produce a latent representation from an audio input, which is forced to be aligned with image and text representations in the multi-modal embedding space.

Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.