Browse State-of-the-Art › Sound Source Localization
Sound Source Localization
39 papers with code · 1 benchmark · 0 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| ^(#!@#)(()))****** (1 row) | YOLO | ODAS: Open embeddeD Audition System | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 104 · with a code link: 39 · where Syntology ran a sample: 6 (6 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (6 of 104 tagged: 6 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 104, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
24 Jun 2022 2 repositories listedSound source localization aims to seek the direction of arrival (DOA) of all sound sources from the observed multi-channel audio.
-
29 Oct 2021 2 repositories listedData-based and learning-based sound source localization (SSL) has shown promising results in challenging conditions, and is commonly set as a classification or a regression problem.
-
8 May 2025 1 repository listedWe introduce a framework that maps audios into tokens compatible with CLIP's text encoder, producing audio-driven embeddings.
-
1 Jan 2025 1 repository listedAudio-visual sound source localization task aims to spatially localize sound-making objects within visual scenes by integrating visual and audio cues.
-
9 Dec 2024 1 repository listed Syntology official (archive's flag): 16 ran · 16 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 12 where Syntology's instrument failed) · 2 unverified (of 18 harvested samples) · 5 pointer-only (licence)We address this challenge by designing a model that aligns audio-visual modalities by enriching audio features with visual information and translating them into the visual latent space.
-
1 Oct 2024 1 repository listedThe task of Visual Sound Source Localization (VSSL) involves identifying the location of sound sources in visual scenes, integrating audio-visual data for enhanced scene understanding.
-
29 Aug 2024 1 repository listedTo address this issue, we propose a novel audio-visual learning framework which is instantiated with two individual learning schemes: self-supervised predictive learning (SSPL) and semantic-aware contrastive learning…
-
28 Aug 2024 1 repository listedWe present a novel approach to the 3D sound source localization task for distributed ad-hoc microphone arrays by formulating it as a set-to-set regression problem.
-
18 Jul 2024 1 repository listedSecond, we introduce new evaluation metrics to rigorously assess sound source localization methods, focusing on accurately evaluating both localization performance and cross-modal interaction ability.
-
11 May 2024 1 repository listedSecond, a new multi-track DP-IPD learning target is proposed for the localization of flexible number of sound sources.
-
30 Apr 2024 1 repository listedIn recent years, Event Sound Source Localization has been widely applied in various fields.
-
26 Mar 2024 1 repository listedIn this paper, to overcome this limitation, we present a novel multi-sound source localization method that can perform localization without prior knowledge of the number of sound sources.
-
26 Mar 2024 1 repository listedDistance estimation from audio plays a crucial role in various applications, such as acoustic scene analysis, sound source localization, and room modeling.
-
21 Nov 2023 1 repository listedTo address this, we propose an Unbiased Label Distribution (ULD) to eliminate quantization error in training targets.
-
7 Nov 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 10 pointer-only (licence)Large-scale pre-trained image-text models demonstrate remarkable versatility across diverse tasks, benefiting from their robust representational capabilities and effective multimodal alignment.
-
2 Nov 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)Multiple Choice Learning is a simple framework to tackle multimodal density estimation, using the Winner-Takes-All (WTA) loss for a set of hypotheses.
-
28 Oct 2023 1 repository listedIn this paper, we propose a new multi-modal task, termed audio-visual instance segmentation (AVIS), which aims to simultaneously identify, segment and track individual sounding object instances in audible videos.
-
23 Oct 2023 1 repository listedGiven audio recordings from 2-4 microphones and the 3D geometry and material of a scene containing multiple unknown sound sources, we estimate the sound anywhere in the scene.
-
11 Aug 2023 1 repository listedWhile the audio modality provides spatial cues to locate the sound source, existing approaches only use audio as an auxiliary role to compare spatial regions of the visual modality.
-
9 Aug 2023 1 repository listedBy decoupling the gradients of visual and audio modalities, the discriminative visual representations of sound sources can be learned with the designed Induction Vector in a bootstrap manner, which also enables the…
-
8 Aug 2023 1 repository listedIn many signal processing applications, metadata may be advantageously used in conjunction with a high dimensional signal to produce a desired output.
-
31 May 2023 1 repository listedExtracting direct-path spatial features is critical for sound source localization in adverse acoustic environments.
-
29 Mar 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)Sound source localization is a typical and challenging task that predicts the location of sound sources in a video.
-
1 Jan 2023 1 repository listedUnderstanding and analyzing human behaviors (actions and interactions of people), voices, and sounds in chaotic events is crucial in many applications, e. g., crowd management, emergency response services.
-
15 Nov 2022 1 repository listedMost recent work in visual sound source localization relies on semantic audio-visual representations learned in a self-supervised manner, and by design excludes temporal information present in videos.
-
6 Nov 2022 1 repository listedExisting work in this area focuses on creating attention maps to capture the correlation between the two modalities to localize the source of the sound.
-
30 Aug 2022 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 1 pointer-only (licence)We also propose a new approach for visual sound source localization that addresses both these problems.
-
25 Mar 2022 1 repository listedSound source localization in visual scenes aims to localize objects emitting the sound in a given image.
-
7 Mar 2022 1 repository listedThe origin transfer function at the head center was obtained by the proposed measurement scheme using a 0 degree on-axis microphone to ensure accurate spectral cue pattern of HRTFs, whereas in the previous measurements…
-
13 Feb 2022 1 repository listedSpecifically, we observe that the previous practice of learning only a single audio representation is insufficient due to the additive nature of audio signals.
-
5 Nov 2021 1 repository listed
-
5 Mar 2021 1 repository listed
-
1 Jan 2021 1 repository listed
-
5 Nov 2020 1 repository listed
-
20 Nov 2019 1 repository listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
3 Sep 2019 1 repository listed
-
28 Aug 2018 1 repository listed
-
10 Apr 2018 1 repository listed
-
30 Nov 2017 1 repository listed
-
A Wireless Self-Calibrating Ultrasound Microphone Array with Sub-Microsecond Synchronization24 Jun 2025 0 repositories listed
-
SHAMaNS: Sound Localization with Hybrid Alpha-Stable Spatial Measure and Neural Steerer23 Jun 2025 0 repositories listed
-
AuralNet: Hierarchical Attention-based 3D Binaural Localization of Overlapping Speakers3 Jun 2025 0 repositories listed
-
Efficient and Microphone-Fault-Tolerant 3D Sound Source Localization27 May 2025 0 repositories listed
-
DiffusionRIR: Room Impulse Response Interpolation using Diffusion Models29 Apr 2025 0 repositories listed
-
Improving Sound Source Localization with Joint Slot Attention on Image and Audio21 Apr 2025 0 repositories listed
-
The trajectoRIR Database: Room Acoustic Recordings Along a Trajectory of Moving Microphones29 Mar 2025 0 repositories listed
-
EEG-Based Decoding of Sound Location: Comparing Free-Field to Headphone-Based Non-Individual HRTFs13 Mar 2025 0 repositories listed
-
CNN-based Robust Sound Source Localization with SRP-PHAT for the Extreme Edge3 Mar 2025 0 repositories listed
-
Graph-Enhanced Dual-Stream Feature Fusion with Pre-Trained Model for Acoustic Traffic Monitoring26 Dec 2024 0 repositories listed
-
SoundLoc3D: Invisible 3D Sound Source Localization and Classification Using a Multimodal RGB-D Acoustic Camera22 Dec 2024 0 repositories listed
-
Mask-Weighted Spatial Likelihood Coding for Speaker-Independent Joint Localization and Mask Estimation25 Oct 2024 0 repositories listed
-
TF-Mamba: A Time-Frequency Network for Sound Source Localization8 Sep 2024 0 repositories listed
-
Leveraging Sound Source Trajectories for Universal Sound Separation7 Sep 2024 0 repositories listed
-
Where's That Voice Coming? Continual Learning for Sound Source Localization4 Jul 2024 0 repositories listed
-
Text-Queried Target Sound Event Localization23 Jun 2024 0 repositories listed
-
Broadband MEMS Microphone Arrays with Reduced Aperture Through 3D-Printed Waveguides11 Jun 2024 0 repositories listed
-
Audio Simulation for Sound Source Localization in Virtual Evironment2 Apr 2024 0 repositories listed
-
T-VSL: Text-Guided Visual Sound Source Localization in Mixtures2 Apr 2024 0 repositories listed
-
Sound event localization and classification using WASN in Outdoor Environment29 Mar 2024 0 repositories listed
-
Feature Aggregation in Joint Sound Classification and Localization Neural Networks29 Oct 2023 0 repositories listed
-
Sound Source Localization is All about Cross-Modal Alignment19 Sep 2023 0 repositories listed
-
Data-driven 3D Room Geometry Inference with a Linear Loudspeaker Array and a Single Microphone28 Aug 2023 0 repositories listed
-
Soft Label Coding for End-to-end Sound Source Localization With Ad-hoc Microphone Arrays15 Apr 2023 0 repositories listed
-
Sound to Visual Scene Generation by Audio-to-Visual Latent Alignment30 Mar 2023 0 repositories listed
-
LOCUS: LOcalization with Channel Uncertainty and Sporadic Energy18 Feb 2023 0 repositories listed
-
Real-Time Acoustic Perception for Automotive Applications30 Jan 2023 0 repositories listed
-
Improving trajectory localization accuracy via direction-of-arrival derivative estimation7 Dec 2022 0 repositories listed
-
MarginNCE: Robust Sound Localization with a Negative Margin3 Nov 2022 0 repositories listed
-
Deep Learning Based Audio-Visual Multi-Speaker DOA Estimation Using Permutation-Free Loss Function26 Oct 2022 0 repositories listed
-
Position tracking of a varying number of sound sources with sliding permutation invariant training26 Oct 2022 0 repositories listed
-
End-to-end Two-dimensional Sound Source Localization With Ad-hoc Microphone Arrays16 Oct 2022 0 repositories listed
-
A Proposal-Based Paradigm for Self-Supervised Sound Source Localization in Videos1 Jan 2022 0 repositories listed
-
Emergency Vehicles Audio Detection and Localization in Autonomous Driving30 Sep 2021 0 repositories listed
-
A Survey of Sound Source Localization with Deep Learning Methods8 Sep 2021 0 repositories listed
-
AcousticFusion: Fusing Sound Source Localization to Visual SLAM in Dynamic Environments3 Aug 2021 0 repositories listed
-
Dual Normalization Multitasking for Audio-Visual Sounding Object Localization1 Jun 2021 0 repositories listed
-
Self-supervised object detection from audio-visual correspondence13 Apr 2021 0 repositories listed
-
Contrastive Self-Supervised Learning of Global-Local Audio-Visual Representations1 Jan 2021 0 repositories listed
-
Data-Efficient Framework for Real-world Multiple Sound Source 2D Localization10 Dec 2020 0 repositories listed
-
Ensemble of Discriminators for Domain Adaptation in Multiple Sound Source 2D Localization10 Dec 2020 0 repositories listed
-
Learning Multiple Sound Source 2D Localization10 Dec 2020 0 repositories listed
-
Beamforming for measurements under disturbed propagation conditions using numerically calculated Green's functions30 Oct 2020 0 repositories listed
-
SSLIDE: Sound Source Localization for Indoors based on Deep Learning27 Oct 2020 0 repositories listed
-
Look, Listen, and Attend: Co-Attention Network for Self-Supervised Audio-Visual Representation Learning13 Aug 2020 0 repositories listed
-
Self-supervised Neural Audio-Visual Sound Source Localization via Probabilistic Spatial Modeling28 Jul 2020 0 repositories listed
-
Do We Need Sound for Sound Source Localization?11 Jul 2020 0 repositories listed
-
Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network7 Jul 2020 0 repositories listed
-
I can attend a meeting too! Towards a human-like telepresence avatar robot to attend meeting on your behalf28 Jun 2020 0 repositories listed
-
Audio-Visual Calibration with Polynomial Regression for 2-D Projection Using SVD-PHAT12 Feb 2020 0 repositories listed
-
Advances in Online Audio-Visual Meeting Transcription10 Dec 2019 0 repositories listed
-
Watch, Listen and Tell: Multi-modal Weakly Supervised Dense Event Captioning22 Sep 2019 0 repositories listed
-
Real-time 3-D Mapping with Estimating Acoustic Materials16 Sep 2019 0 repositories listed
-
Proceedings of the LOCATA Challenge Workshop -- a satellite event of IWAENC 201820 Aug 2019 0 repositories listed
-
Fast and Robust 3-D Sound Source Localization with DSVD-PHAT29 Jul 2019 0 repositories listed
-
Mirage: 2D Source Localization Using Microphone Pair Augmentation with Echoes21 Jun 2019 0 repositories listed
-
A Signal Subspace Rotation Method for Localization of Multiple Wideband Sound Sources20 Jun 2019 0 repositories listed
-
Enhanced Robot Speech Recognition Using Biomimetic Binaural Sound Source Localization13 Feb 2019 0 repositories listed
-
SVD-PHAT: A Fast Sound Source Localization Method11 Feb 2019 0 repositories listed
-
Learning to Localize Sound Source in Visual Scenes10 Mar 2018 0 repositories listed
-
Phased Microphone Array for Sound Source Localization with Deep Learning13 Feb 2018 0 repositories listed
Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections