Browse State-of-the-Art › Speech Extraction

Speech Extraction

10 papers with code · 1 benchmark · 3 datasets archive 2025-07-28

Speech

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

DatasetBest model (first row in archive order)PaperCodeSyntologyCompare
WSJ0-2mix-extr (1 row) SpEx+ (tied) SpEx+: A Complete Time Domain Speaker Extraction Network — — Compare

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

3 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Papers archive 2025-07-28

archive papers tagged: 48 · with a code link: 10 · where Syntology ran a sample: 1 (0 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (1 of 48 tagged: 0 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 48 of 48, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.

  • 25 May 2025 1 repository listed
    On the other hand, generative models for TSE lag in perceptual quality and intelligibility.
  • 15 Jan 2025 1 repository listed
    To train and evaluate our model, we introduce a new dataset TextrolMix with speech mixtures and natural language descriptions.
  • 24 Sep 2024 1 repository listed
    The proposed method is evaluated on multiple speech restoration tasks, including speech denoising, bandwidth extension, codec artifact removal, and target speaker extraction.
  • We present the first enrollment interface where the wearer looks at the target speaker for a few seconds to capture a single, short, highly noisy, binaural example of the target speaker.
  • 31 Jan 2023 1 repository listed
    Humans can listen to a target speaker even in challenging acoustic conditions that have noise, reverberation, and interfering speakers.
  • 15 Aug 2022 1 repository listed
    One of the factors causing such degradation may be intrinsic speaker variability, such as emotions, occurring commonly in realistic speech.
  • 22 Jun 2022 1 repository listed
    Employing deep neural networks (DNNs) to directly learn filters for multi-channel speech enhancement has potentially two key advantages over a traditional approach combining a linear spatial filter with an independent…
  • 27 Dec 2021 1 repository listed
    Particularly, we find that the Mixture-Remix fine-tuning with DPCCN significantly outperforms the TD-SpeakerBeam for unsupervised cross-domain TSE, with around 3.
  • 16 May 2020 1 repository listed
    Extracting the desired speech from a mixture is a meaningful and challenging task.
  • 23 Jan 2020 1 repository listed
    First, we propose a time-domain implementation of SpeakerBeam similar to that proposed for a time-domain audio separation network (TasNet), which has achieved state-of-the-art performance for speech separation.
  • Incorporating Linguistic Constraints from External Knowledge Source for Audio-Visual Target Speech Extraction
    11 Jun 2025 0 repositories listed
    Audio-visual target speaker extraction (AV-TSE) models primarily rely on target visual cues to isolate the target speaker's voice from others.
  • Inter-Speaker Relative Cues for Text-Guided Target Speech Extraction
    2 Jun 2025 0 repositories listed
    We propose a novel approach that utilizes inter-speaker relative cues to distinguish target speakers and extract their voices from mixtures.
  • Single-Channel Target Speech Extraction Utilizing Distance and Room Clues
    20 May 2025 0 repositories listed
    This paper aims to achieve single-channel target speech extraction (TSE) in enclosures utilizing distance clues and room information.
  • SonicSieve: Bringing Directional Speech Extraction to Smartphones Using Acoustic Microstructures
    15 Apr 2025 0 repositories listed
    Imagine placing your smartphone on a table in a noisy restaurant and clearly capturing the voices of friends seated around you, or recording a lecturer's voice with clarity in a reverberant auditorium.
  • Contextual Speech Extraction: Leveraging Textual History as an Implicit Cue for Target Speech Extraction
    11 Mar 2025 0 repositories listed
    In this paper, we investigate a novel approach for Target Speech Extraction (TSE), which relies solely on textual context to extract the target speech.
  • Enhancing Intelligibility for Generative Target Speech Extraction via Joint Optimization with Target Speaker ASR
    24 Jan 2025 0 repositories listed
    Target speech extraction (TSE) isolates the speech of a specific speaker from a multi-talker overlapped speech mixture.
  • Distance Based Single-Channel Target Speech Extraction
    28 Dec 2024 0 repositories listed
    This paper aims to achieve single-channel target speech extraction (TSE) in enclosures by solely utilizing distance information.
  • Investigation of Speaker Representation for Target-Speaker Speech Processing
    15 Oct 2024 0 repositories listed
    Target-speaker speech processing (TS) tasks, such as target-speaker automatic speech recognition (TS-ASR), target speech extraction (TSE), and personal voice activity detection (p-VAD), are important for extracting…
  • Separate in the Speech Chain: Cross-Modal Conditional Audio-Visual Target Speech Extraction
    19 Apr 2024 0 repositories listed
    The integration of visual cues has revitalized the performance of the target speech extraction task, elevating it to the forefront of the field.
  • Probing Self-supervised Learning Models with Target Speech Extraction
    17 Feb 2024 0 repositories listed
    Large-scale pre-trained self-supervised learning (SSL) models have shown remarkable advancements in speech-related tasks.
  • Target Speech Extraction with Pre-trained Self-supervised Learning Models
    17 Feb 2024 0 repositories listed
    Pre-trained self-supervised learning (SSL) models have achieved remarkable success in various speech tasks.
  • Self-Supervised Disentangled Representation Learning for Robust Target Speech Extraction
    16 Dec 2023 0 repositories listed
    Speech signals are inherently complex as they encompass both global acoustic characteristics and local semantic information.
  • Scenario-Aware Audio-Visual TF-GridNet for Target Speech Extraction
    30 Oct 2023 0 repositories listed
    Target speech extraction aims to extract, based on a given conditioning cue, a target speech signal that is corrupted by interfering sources, such as noise or competing speakers.
  • AutoPrep: An Automatic Preprocessing Framework for In-the-Wild Speech Data
    25 Sep 2023 0 repositories listed
    Recently, the utilization of extensive open-sourced text data has significantly advanced the performance of text-based large language models (LLMs).
  • DDTSE: Discriminative Diffusion Model for Target Speech Extraction
    25 Sep 2023 0 repositories listed
    Diffusion models have gained attention in speech enhancement tasks, providing an alternative to conventional discriminative methods.
  • Target Speech Extraction with Conditional Diffusion Model
    8 Aug 2023 0 repositories listed
    Diffusion model-based speech enhancement has received increased attention since it can generate very natural enhanced signals and generalizes well to unseen conditions.
  • Enhanced Neural Beamformer with Spatial Information for Target Speech Extraction
    28 Jun 2023 0 repositories listed
    Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks.
  • Audio-Visual Speech Enhancement With Selective Off-Screen Speech Extraction
    10 Jun 2023 0 repositories listed
    This paper describes an audio-visual speech enhancement (AV-SE) method that estimates from noisy input audio a mixture of the speech of the speaker appearing in an input video (on-screen target speech) and of a selected…
  • Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data
    25 May 2023 0 repositories listed
    Neural transducer (RNNT)-based target-speaker speech recognition (TS-RNNT) directly transcribes a target speaker's voice from a multi-talker mixture.
  • X-SepFormer: End-to-end Speaker Extraction Network with Explicit Optimization on Speaker Confusion
    9 Mar 2023 0 repositories listed
    Target speech extraction (TSE) systems are designed to extract target speech from a multi-talker mixture.
  • Quotations, Coreference Resolution, and Sentiment Annotations in Croatian News Articles: An Exploratory Study
    14 Dec 2022 0 repositories listed
  • Streaming Target-Speaker ASR with Neural Transducer
    9 Sep 2022 0 repositories listed
  • ConceptBeam: Concept Driven Target Speech Extraction
    25 Jul 2022 0 repositories listed
  • Dual-Path Cross-Modal Attention for better Audio-Visual Speech Extraction
    9 Jul 2022 0 repositories listed
  • Simultaneous Speech Extraction for Multiple Target Speakers under the Meeting Scenarios
    17 Jun 2022 0 repositories listed
  • Strategies to Improve Robustness of Target Speech Extraction to Enrollment Variations
    16 Jun 2022 0 repositories listed
  • Listen only to me! How well can target speech extraction handle false alarms?
    11 Apr 2022 0 repositories listed
  • Deep Learning-Based Joint Control of Acoustic Echo Cancellation, Beamforming and Postfiltering
    3 Mar 2022 0 repositories listed
  • Learning-based personal speech enhancement for teleconferencing by exploiting spatial-spectral features
    10 Dec 2021 0 repositories listed
  • Target Speech Extraction: Independent Vector Extraction Guided by Supervised Speaker Identification
    5 Nov 2021 0 repositories listed
  • All-neural beamformer for continuous speech separation
    13 Oct 2021 0 repositories listed
  • Improving Channel Decorrelation for Multi-Channel Target Speech Extraction
    6 Jun 2021 0 repositories listed
  • Time-Domain Speech Extraction with Spatial Information and Multi Speaker Conditioning Mechanism
    7 Feb 2021 0 repositories listed
  • Speaker activity driven neural speech extraction
    14 Jan 2021 0 repositories listed
  • Speaker Separation Using Speaker Inventories and Estimated Speech
    20 Oct 2020 0 repositories listed
  • Attention-based scaling adaptation for target speech extraction
    19 Oct 2020 0 repositories listed
  • Multi-talker ASR for an unknown number of sources: Joint training of source counting, separation and ASR
    4 Jun 2020 0 repositories listed
  • Algorithm for Independent Vector Extraction Based on Semi-Time-Variant Mixing Model
    22 Oct 2019 0 repositories listed

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections