Audio Tagging

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

10 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 49 papers with code (81 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• AST: Audio Spectrogram Transformer
  5 Apr 2021 5 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for end-to-end audio classification models, which aim to learn a direct mapping from audio spectrograms to…
• Speech Denoising with Deep Feature Losses
  27 Jun 2018 5 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  We present an end-to-end deep learning approach to denoising speech signals by processing the raw waveform directly.
• musicnn: Pre-trained convolutional neural networks for music audio tagging
  14 Sep 2019 4 repositories listed Syntology ran 1 of 8 samples · 7 unverified
  Pronounced as "musician", the musicnn library contains a set of pre-trained musically motivated convolutional neural networks for music audio tagging: https://github.
• General-purpose Tagging of Freesound Audio with AudioSet Labels: Task Description, Dataset, and Baseline
  26 Jul 2018 3 repositories listed
  The goal of the task is to build an audio tagging system that can recognize the category of an audio clip from a subset of 41 diverse categories drawn from the AudioSet Ontology.
• M2D2: Exploring General-purpose Audio-Language Representations Beyond CLAP
  28 Mar 2025 2 repositories listed
  In the second stage, it learns CLAP features using the audio features learned from the LLM-based embeddings.
• Audio classification with Dilated Convolution with Learnable Spacings
  25 Sep 2023 2 repositories listed
  Dilated convolution with learnable spacings (DCLS) is a recent convolution method in which the positions of the kernel elements are learned throughout training by backpropagation.
• Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Tasks
  7 Jun 2023 2 repositories listed
  In order to tackle both clip-level and frame-level tasks, this paper proposes Audio Teacher-Student Transformer (ATST), with a clip-level version (named ATST-Clip) and a frame-level version (named ATST-Frame),…
• Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation
  9 Nov 2022 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified
  We provide models of different complexity levels, scaling from low-complexity models up to a new state-of-the-art performance of .
• Efficient Training of Audio Transformers with Patchout
  11 Oct 2021 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  However, one of the main shortcomings of transformer models, compared to the well-established CNNs, is the computational complexity.
• CRNNs for Urban Sound Tagging with spatiotemporal context
  24 Aug 2020 2 repositories listed
  This paper describes CRNNs we used to participate in Task 5 of the DCASE 2020 challenge.
• Audio tagging with noisy labels and minimal supervision
  7 Jun 2019 2 repositories listed
  The task evaluates systems for multi-label audio tagging using a large set of noisy-labeled data, and a much smaller set of manually-labeled data, under a large vocabulary setting of 80 everyday sound classes.
• General audio tagging with ensembling convolutional neural network and statistical features
  30 Oct 2018 2 repositories listed
  Audio tagging is challenging due to the limited size of data and noisy labels.
• Speech Denoising Convolutional Neural Network trained with Deep Feature Losses.
  27 Jun 2018 2 repositories listed
  We present an end-to-end deep learning approach to denoising speech signals by processing the raw waveform directly.
• Convolutional Gated Recurrent Neural Network Incorporating Spatial Features for Audio Tagging
  24 Feb 2017 2 repositories listed
  In this paper, we propose to use a convolutional neural network (CNN) to extract robust features from mel-filter banks (MFBs), spectrograms or even raw waveforms for audio tagging.
• Unsupervised Feature Learning Based on Deep Models for Environmental Audio Tagging
  13 Jul 2016 2 repositories listed
  For the unsupervised feature learning, we propose to use a symmetric or asymmetric deep de-noising auto-encoder (sDAE or aDAE) to generate new data-driven features from the Mel-Filter Banks (MFBs) features.
• Baseline Systems and Evaluation Metrics for Spatial Semantic Segmentation of Sound Scenes
  28 Mar 2025 1 repository listed
  Immersive communication has made significant advancements, especially with the release of the codec for Immersive Voice and Audio Services.
• Hierarchical Label Propagation: A Model-Size-Dependent Performance Booster for AudioSet Tagging
  26 Mar 2025 1 repository listed
  AudioSet is one of the most used and largest datasets in audio tagging, containing about 2 million audio samples that are manually labeled with 527 event categories organized into an ontology.
• Solla: Towards a Speech-Oriented LLM That Hears Acoustic Context
  19 Mar 2025 1 repository listed
  Large Language Models (LLMs) have recently shown remarkable ability to process not only text but also multimodal inputs such as speech and audio.
• Exploring Performance-Complexity Trade-Offs in Sound Event Detection Models
  14 Mar 2025 1 repository listed
  We target the problem of developing new low-complexity networks for the sound event detection task.
• Masked Latent Prediction and Classification for Self-Supervised Audio Representation Learning
  17 Feb 2025 1 repository listed
  Therefore, we propose a new method: MAsked latenT Prediction And Classification (MATPAC), which is trained with two pretext tasks solved jointly.
• LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Tagging
  17 Sep 2024 1 repository listed
  We introduce Label-Combination Prototypical Networks (LC-Protonets) to address the problem of multi-label few-shot classification, where a model must generalize to new classes based on only a few available examples.
• Integrating IP Broadcasting with Audio Tags: Workflow and Challenges
  22 Jul 2024 1 repository listed
  The broadcasting industry is increasingly adopting IP techniques, revolutionising both live and pre-recorded content production, from news gathering to live music events.
• DASS: Distilled Audio State Space Models Are Stronger and More Duration-Scalable Learners
  4 Jul 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  To the best of our knowledge, it is the first SSM that outperforms the Transformers on AudioSet and achieves an mAP of 48.
• Perceptual Musical Features for Interpretable Audio Tagging
  18 Dec 2023 1 repository listed
  In the age of music streaming platforms, the task of automatically tagging music audio has garnered significant attention, driving researchers to devise methods aimed at enhancing performance metrics on standard…
• Dynamic Convolutional Neural Networks as Efficient Pre-trained Audio Models
  24 Oct 2023 1 repository listed
  Audio Spectrogram Transformers are excellent at exploiting large datasets, creating powerful pre-trained models that surpass CNNs when fine-tuned on downstream tasks.
• Audio Tagging on an Embedded Hardware Platform
  15 Jun 2023 1 repository listed
  In this paper, we analyze how the performance of large-scale pretrained audio neural networks designed for audio pattern recognition changes when deployed on a hardware such as Raspberry Pi.
• E-PANNs: Sound Recognition Using Efficient Pre-trained Audio Neural Networks
  30 May 2023 1 repository listed
  Sounds carry an abundance of information about activities and events in our everyday environment, such as traffic noise, road works, music, or people talking.
• Robust Cross-Modal Knowledge Distillation for Unconstrained Videos
  16 Apr 2023 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  However, such semantic consistency from the synchronization is hard to guarantee in unconstrained videos, due to the irrelevant modality noise and differentiated semantic correlation.
• Zorro: the masked multimodal transformer
  23 Jan 2023 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  Attention-based models are appealing for multimodal processing because inputs from multiple modalities can be concatenated and fed to a single backbone network - thus requiring very little fusion engineering.
• Ontology-aware Learning and Evaluation for Audio Tagging
  22 Nov 2022 1 repository listed
  The proposed metric, ontology-aware mean average precision (OmAP) addresses the weaknesses of mAP by utilizing the AudioSet ontology information during the evaluation.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.