Browse State-of-the-Art › Instrument Recognition
Instrument Recognition
26 papers with code · 3 benchmarks · 4 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| NSynth (7 rows) | M2D-CLAP | M2D2: Exploring General-purpose Audio-Language Representations Beyond CLAP | code | — | Compare |
| OpenMIC-2018 (5 rows) | DyMN-L | Dynamic Convolutional Neural Networks as Efficient Pre-trained Audio Models | code | — | Compare |
| IRMAS (1 row) | SVM | Predominant Musical Instrument Classification based on Spectral Features | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 39 · with a code link: 26 · where Syntology ran a sample: 2 (1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2 of 39 tagged: 1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 39 of 39, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
26 Apr 2022 4 repositories listedSelf-supervised learning (SSL) learns knowledge from a large amount of unlabeled data, and then transfers the knowledge to a specific problem with a limited number of labeled data.
-
22 Apr 2021 3 repositories listedTo utilize automated methods in clinical settings, it is crucial to design lightweight models with low latency such that they can be integrated with low-end endoscope hardware devices.
-
28 Mar 2025 2 repositories listedIn the second stage, it learns CLAP features using the audio features learned from the LLM-based embeddings.
-
7 Jun 2023 2 repositories listedIn order to tackle both clip-level and frame-level tasks, this paper proposes Audio Teacher-Student Transformer (ATST), with a clip-level version (named ATST-Clip) and a frame-level version (named ATST-Frame)…
-
11 Oct 2021 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)However, one of the main shortcomings of transformer models, compared to the well-established CNNs, is the computational complexity.
-
26 Jun 2025 1 repository listedIdentifying instrument activities within audio excerpts is vital in music information retrieval, with significant implications for music cataloging and discovery.
-
17 Feb 2025 1 repository listedTherefore, we propose a new method: MAsked latenT Prediction And Classification (MATPAC), which is trained with two pretext tasks solved jointly.
-
1 Nov 2024 1 repository listedThis paper introduces an extendable modular system that compiles a range of music feature extraction models to aid music information retrieval research.
-
25 Jul 2024 1 repository listedWe present an evaluation and analysis of two-tower systems for zero-shot instrument recognition and a detailed analysis of the properties of the pre-joint and joint embeddings spaces.
-
26 Jun 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)Of the very few current systems that support source separation beyond this setup, most continue to rely on an inflexible decoder setup that can only support a fixed pre-defined set of stems.
-
24 Oct 2023 1 repository listedAudio Spectrogram Transformers are excellent at exploiting large datasets, creating powerful pre-trained models that surpass CNNs when fine-tuned on downstream tasks.
-
20 Jul 2023 1 repository listedThis approach allows representations derived for one task to be applied to another, and can result in high accuracy with less stringent training data requirements for the downstream task.
-
30 Jun 2023 1 repository listedMusic classification has been one of the most popular tasks in the field of music information retrieval.
-
29 Jun 2023 1 repository listedIt focuses on the visualization of the occurrence of phases, phase transitions, instruments, and instrument combinations across sets.
-
12 Jul 2022 1 repository listedIn audio classification, differentiable auditory filterbanks with few parameters cover the middle ground between hard-coded spectrograms and raw audio.
-
19 Aug 2021 1 repository listedThis paper propose a traditional Chinese music dataset for training model and performance evaluation, named ChMusic.
-
24 Jul 2021 1 repository listedConstructing an embedding space for musical instrument sounds that can meaningfully represent new and unseen instruments is important for downstream music generation tasks such as multi-instrument synthesis and timbre…
-
14 Jul 2021 1 repository listedDeep learning work on musical instrument recognition has generally focused on instrument classes for which we have abundant data.
-
26 May 2021 1 repository listedAs state-of-the-art CNN architectures-in computer vision and other domains-tend to go deeper in terms of number of layers, their RF size increases and therefore they degrade in performance in several audio…
-
23 Oct 2020 1 repository listedAdditionally, we provide a baseline for the segmentation of the GI tools to promote research and algorithm development.
-
30 Nov 2019 1 repository listedThis work aims to examine one of the cornerstone problems of Musical Instrument Retrieval (MIR), in particular, instrument classification.
-
28 Nov 2019 1 repository listedInstrument classification is one of the fields in Music Information Retrieval (MIR) that has attracted a lot of research interest.
-
9 Jul 2019 1 repository listedWhile the automatic recognition of musical instruments has seen significant progress, the task is still considered hard for music featuring multiple instruments as opposed to single instrument recordings.
-
4 Dec 2018 1 repository listedResults: We build a baseline tracker on top of the CNN model and demonstrate that our approach based on the ConvLSTM outperforms the baseline in tool presence detection, spatial localization, and motion tracking by over…
-
31 May 2016 1 repository listedWe train our network from fixed-length music excerpts with a single-labeled predominant instrument and estimate an arbitrary number of predominant instruments from an audio signal with a variable length.
-
17 Nov 2015 1 repository listedTraditional methods to tackle many music information retrieval tasks typically follow a two-step architecture: feature engineering followed by a simple learning algorithm.
-
Can DeepSeek Reason Like a Surgeon? An Empirical Evaluation for Vision-Language Understanding in Robotic-Assisted Surgery29 Mar 2025 0 repositories listedThe DeepSeek models have shown exceptional performance in general scene understanding, question-answering (QA), and text generation tasks, owing to their efficient training paradigm and strong reasoning capabilities.
-
SurgRAW: Multi-Agent Workflow with Chain-of-Thought Reasoning for Surgical Intelligence13 Mar 2025 0 repositories listedIntegration of Vision-Language Models (VLMs) in surgical intelligence is hindered by hallucinations, domain knowledge gaps, and limited understanding of task interdependencies within surgical scenes, undermining…
-
Deep Learning for Surgical Instrument Recognition and Segmentation in Robotic-Assisted Surgeries: A Systematic Review9 Oct 2024 0 repositories listedApplying deep learning (DL) for annotating surgical instruments in robot-assisted minimally invasive surgeries (MIS) represents a significant advancement in surgical technology.
-
PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgery2 Sep 2024 0 repositories listedThe field of computer vision applied to videos of minimally invasive surgery is ever-growing.
-
WeakSurg: Weakly supervised surgical instrument segmentation using temporal equivariance and semantic continuity14 Mar 2024 0 repositories listed
-
Self-refining of Pseudo Labels for Music Source Separation with Noisy Labeled Data24 Jul 2023 0 repositories listed
-
Jointist: Simultaneous Improvement of Multi-instrument Transcription and Music Source Separation via Joint Training1 Feb 2023 0 repositories listed
-
22 Jun 2022 0 repositories listed
-
Deep Neural Network for Musical Instrument Recognition using MFCCs3 May 2021 0 repositories listed
-
Visual Attention for Musical Instrument Recognition17 Jun 2020 0 repositories listed
-
Cross-modal variational inference for bijective signal-symbol translation10 Feb 2020 0 repositories listed
-
Musical Instrument Recognition Using Their Distinctive Characteristics in Artificial Neural Networks14 May 2017 0 repositories listed
-
Deep scattering transform applied to note onset detection and instrument recognition28 Mar 2017 0 repositories listed
Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections