Sound Source Localization

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 39 papers with code (104 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Iterative Sound Source Localization for Unknown Number of Sources
  24 Jun 2022 2 repositories listed
  Sound source localization aims to seek the direction of arrival (DOA) of all sound sources from the observed multi-channel audio.
• Differentiable Tracking-Based Training of Deep Learning Sound Source Localizers
  29 Oct 2021 2 repositories listed
  Data-based and learning-based sound source localization (SSL) has shown promising results in challenging conditions, and is commonly set as a classification or a regression problem.
• Hearing and Seeing Through CLIP: A Framework for Self-Supervised Sound Source Localization
  8 May 2025 1 repository listed
  We introduce a framework that maps audios into tokens compatible with CLIP's text encoder, producing audio-driven embeddings.
• Object-aware Sound Source Localization via Audio-Visual Scene Understanding
  1 Jan 2025 1 repository listed
  Audio-visual sound source localization task aims to spatially localize sound-making objects within visual scenes by integrating visual and audio cues.
• Sound2Vision: Generating Diverse Visuals from Audio through Cross-Modal Latent Alignment
  9 Dec 2024 1 repository listed Syntology ran 5 of 18 samples · 13 unverified
  We address this challenge by designing a model that aligns audio-visual modalities by enriching audio features with visual information and translating them into the visual latent space.
• A Critical Assessment of Visual Sound Source Localization Models Including Negative Audio
  1 Oct 2024 1 repository listed
  The task of Visual Sound Source Localization (VSSL) involves identifying the location of sound sources in visual scenes, integrating audio-visual data for enhanced scene understanding.
• Enhancing Sound Source Localization via False Negative Elimination
  29 Aug 2024 1 repository listed
  To address this issue, we propose a novel audio-visual learning framework which is instantiated with two individual learning schemes: self-supervised predictive learning (SSPL) and semantic-aware contrastive learning…
• wav2pos: Sound Source Localization using Masked Autoencoders
  28 Aug 2024 1 repository listed
  We present a novel approach to the 3D sound source localization task for distributed ad-hoc microphone arrays by formulating it as a set-to-set regression problem.
• Aligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment
  18 Jul 2024 1 repository listed
  Second, we introduce new evaluation metrics to rigorously assess sound source localization methods, focusing on accurately evaluating both localization performance and cross-modal interaction ability.
• IPDnet: A Universal Direct-Path IPD Estimation Network for Sound Source Localization
  11 May 2024 1 repository listed
  Second, a new multi-track DP-IPD learning target is proposed for the localization of flexible number of sound sources.
• SemiPL: A Semi-supervised Method for Event Sound Source Localization
  30 Apr 2024 1 repository listed
  In recent years, Event Sound Source Localization has been widely applied in various fields.
• Learning to Visually Localize Sound Sources from Mixtures without Prior Source Knowledge
  26 Mar 2024 1 repository listed
  In this paper, to overcome this limitation, we present a novel multi-sound source localization method that can perform localization without prior knowledge of the number of sound sources.
• Speaker Distance Estimation in Enclosures from Single-Channel Audio
  26 Mar 2024 1 repository listed
  Distance estimation from audio plays a crucial role in various applications, such as acoustic scene analysis, sound source localization, and room modeling.
• Eliminating Quantization Errors in Classification-Based Sound Source Localization
  21 Nov 2023 1 repository listed
  To address this, we propose an Unbiased Label Distribution (ULD) to eliminate quantization error in training targets.
• Can CLIP Help Sound Source Localization?
  7 Nov 2023 1 repository listed Syntology ran 10 of 10 samples · 0 unverified · 10 pointer-only (licence)
  Large-scale pre-trained image-text models demonstrate remarkable versatility across diverse tasks, benefiting from their robust representational capabilities and effective multimodal alignment.
• Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysis
  2 Nov 2023 1 repository listed Syntology ran 6 of 6 samples · 0 unverified
  Multiple Choice Learning is a simple framework to tackle multimodal density estimation, using the Winner-Takes-All (WTA) loss for a set of hypotheses.
• Audio-Visual Instance Segmentation
  28 Oct 2023 1 repository listed
  In this paper, we propose a new multi-modal task, termed audio-visual instance segmentation (AVIS), which aims to simultaneously identify, segment and track individual sounding object instances in audible videos.
• Novel-View Acoustic Synthesis from 3D Reconstructed Rooms
  23 Oct 2023 1 repository listed
  Given audio recordings from 2-4 microphones and the 3D geometry and material of a scene containing multiple unknown sound sources, we estimate the sound anywhere in the scene.
• Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localization
  11 Aug 2023 1 repository listed
  While the audio modality provides spatial cues to locate the sound source, existing approaches only use audio as an auxiliary role to compare spatial regions of the visual modality.
• Induction Network: Audio-Visual Modality Gap-Bridging for Self-Supervised Sound Source Localization
  9 Aug 2023 1 repository listed
  By decoupling the gradients of visual and audio modalities, the discriminative visual representations of sound sources can be learned with the designed Induction Vector in a bootstrap manner, which also enables the…
• Dual input neural networks for positional sound source localization
  8 Aug 2023 1 repository listed
  In many signal processing applications, metadata may be advantageously used in conjunction with a high dimensional signal to produce a desired output.
• FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localization
  31 May 2023 1 repository listed
  Extracting direct-path spatial features is critical for sound source localization in adverse acoustic environments.
• Audio-Visual Grouping Network for Sound Localization from Mixtures
  29 Mar 2023 1 repository listed Syntology ran 6 of 11 samples · 5 unverified
  Sound source localization is a typical and challenging task that predicts the location of sound sources in a video.
• Chaotic World: A Large and Challenging Benchmark for Human Behavior Understanding in Chaotic Events
  1 Jan 2023 1 repository listed
  Understanding and analyzing human behaviors (actions and interactions of people), voices, and sounds in chaotic events is crucial in many applications, e.
• FlowGrad: Using Motion for Visual Sound Source Localization
  15 Nov 2022 1 repository listed
  Most recent work in visual sound source localization relies on semantic audio-visual representations learned in a self-supervised manner, and by design excludes temporal information present in videos.
• Hear The Flow: Optical Flow-Based Self-Supervised Visual Sound Source Localization
  6 Nov 2022 1 repository listed
  Existing work in this area focuses on creating attention maps to capture the correlation between the two modalities to localize the source of the sound.
• A Closer Look at Weakly-Supervised Audio-Visual Source Localization
  30 Aug 2022 1 repository listed Syntology ran 4 of 6 samples · 2 unverified
  We also propose a new approach for visual sound source localization that addresses both these problems.
• Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes
  25 Mar 2022 1 repository listed
  Sound source localization in visual scenes aims to localize objects emitting the sound in a given image.
• HRTF measurement for accurate sound localization cues
  7 Mar 2022 1 repository listed
  The origin transfer function at the head center was obtained by the proposed measurement scheme using a 0 degree on-axis microphone to ensure accurate spectral cue pattern of HRTFs, whereas in the previous measurements…
• Visual Sound Localization in the Wild by Cross-Modal Interference Erasing
  13 Feb 2022 1 repository listed
  Specifically, we observe that the previous practice of learning only a single audio representation is insufficient due to the additive nature of audio signals.

Syntology lines on 5 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.