Instrument Recognition

Benchmarks archive 2025-07-28

3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

26 shown of 26 papers with code (39 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• ATST: Audio Representation Learning with Teacher-Student Transformer
  26 Apr 2022 4 repositories listed
  Self-supervised learning (SSL) learns knowledge from a large amount of unlabeled data, and then transfers the knowledge to a specific problem with a limited number of labeled data.
• NanoNet: Real-Time Polyp Segmentation in Video Capsule Endoscopy and Colonoscopy
  22 Apr 2021 3 repositories listed
  To utilize automated methods in clinical settings, it is crucial to design lightweight models with low latency such that they can be integrated with low-end endoscope hardware devices.
• M2D2: Exploring General-purpose Audio-Language Representations Beyond CLAP
  28 Mar 2025 2 repositories listed
  In the second stage, it learns CLAP features using the audio features learned from the LLM-based embeddings.
• Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Tasks
  7 Jun 2023 2 repositories listed
  In order to tackle both clip-level and frame-level tasks, this paper proposes Audio Teacher-Student Transformer (ATST), with a clip-level version (named ATST-Clip) and a frame-level version (named ATST-Frame),…
• Efficient Training of Audio Transformers with Patchout
  11 Oct 2021 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  However, one of the main shortcomings of transformer models, compared to the well-established CNNs, is the computational complexity.
• A Hierarchical Deep Learning Approach for Minority Instrument Detection
  26 Jun 2025 1 repository listed
  Identifying instrument activities within audio excerpts is vital in music information retrieval, with significant implications for music cataloging and discovery.
• Masked Latent Prediction and Classification for Self-Supervised Audio Representation Learning
  17 Feb 2025 1 repository listed
  Therefore, we propose a new method: MAsked latenT Prediction And Classification (MATPAC), which is trained with two pretext tasks solved jointly.
• MIRFLEX: Music Information Retrieval Feature Library for Extraction
  1 Nov 2024 1 repository listed
  This paper introduces an extendable modular system that compiles a range of music feature extraction models to aid music information retrieval research.
• I can listen but cannot read: An evaluation of two-tower multimodal systems for instrument recognition
  25 Jul 2024 1 repository listed
  We present an evaluation and analysis of two-tower systems for zero-shot instrument recognition and a detailed analysis of the properties of the pre-joint and joint embeddings spaces.
• A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stems
  26 Jun 2024 1 repository listed Syntology ran 4 of 4 samples · 0 unverified
  Of the very few current systems that support source separation beyond this setup, most continue to rely on an inflexible decoder setup that can only support a fixed pre-defined set of stems.
• Dynamic Convolutional Neural Networks as Efficient Pre-trained Audio Models
  24 Oct 2023 1 repository listed
  Audio Spectrogram Transformers are excellent at exploiting large datasets, creating powerful pre-trained models that surpass CNNs when fine-tuned on downstream tasks.
• Transfer Learning and Bias Correction with Pre-trained Audio Embeddings
  20 Jul 2023 1 repository listed
  This approach allows representations derived for one task to be applied to another, and can result in high accuracy with less stringent training data requirements for the downstream task.
• Audio Embeddings as Teachers for Music Classification
  30 Jun 2023 1 repository listed
  Music classification has been one of the most popular tasks in the field of music information retrieval.
• Surgical Phase and Instrument Recognition: How to identify appropriate Dataset Splits
  29 Jun 2023 1 repository listed
  It focuses on the visualization of the occurrence of phases, phase transitions, instruments, and instrument combinations across sets.
• EfficientLEAF: A Faster LEarnable Audio Frontend of Questionable Use
  12 Jul 2022 1 repository listed
  In audio classification, differentiable auditory filterbanks with few parameters cover the middle ground between hard-coded spectrograms and raw audio.
• ChMusic: A Traditional Chinese Music Dataset for Evaluation of Instrument Recognition
  19 Aug 2021 1 repository listed
  This paper propose a traditional Chinese music dataset for training model and performance evaluation, named ChMusic.
• Use of speaker recognition approaches for learning and evaluating embedding representations of musical instrument sounds
  24 Jul 2021 1 repository listed
  Constructing an embedding space for musical instrument sounds that can meaningfully represent new and unseen instruments is important for downstream music generation tasks such as multi-instrument synthesis and timbre…
• Leveraging Hierarchical Structures for Few-Shot Musical Instrument Recognition
  14 Jul 2021 1 repository listed
  Deep learning work on musical instrument recognition has generally focused on instrument classes for which we have abundant data.
• Receptive Field Regularization Techniques for Audio Classification and Tagging with Deep Convolutional Neural Networks
  26 May 2021 1 repository listed
  As state-of-the-art CNN architectures-in computer vision and other domains-tend to go deeper in terms of number of layers, their RF size increases and therefore they degrade in performance in several audio…
• Kvasir-Instrument: Diagnostic and therapeutic tool segmentation dataset in gastrointestinal endoscopy
  23 Oct 2020 1 repository listed
  Additionally, we provide a baseline for the segmentation of the GI tools to promote research and algorithm development.
• Predominant Musical Instrument Classification based on Spectral Features
  30 Nov 2019 1 repository listed
  This work aims to examine one of the cornerstone problems of Musical Instrument Retrieval (MIR), in particular, instrument classification.
• Augmentation Methods on Monophonic Audio for Instrument Classification in Polyphonic Music
  28 Nov 2019 1 repository listed
  Instrument classification is one of the fields in Music Information Retrieval (MIR) that has attracted a lot of research interest.
• An Attention Mechanism for Musical Instrument Recognition
  9 Jul 2019 1 repository listed
  While the automatic recognition of musical instruments has seen significant progress, the task is still considered hard for music featuring multiple instruments as opposed to single instrument recordings.
• Weakly Supervised Convolutional LSTM Approach for Tool Tracking in Laparoscopic Videos
  4 Dec 2018 1 repository listed
  Results: We build a baseline tracker on top of the CNN model and demonstrate that our approach based on the ConvLSTM outperforms the baseline in tool presence detection, spatial localization, and motion tracking by over…
• Deep convolutional neural networks for predominant instrument recognition in polyphonic music
  31 May 2016 1 repository listed
  We train our network from fixed-length music excerpts with a single-labeled predominant instrument and estimate an arbitrary number of predominant instruments from an audio signal with a variable length.
• Automatic Instrument Recognition in Polyphonic Music Using Convolutional Neural Networks
  17 Nov 2015 1 repository listed
  Traditional methods to tackle many music information retrieval tasks typically follow a two-step architecture: feature engineering followed by a simple learning algorithm.

Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.