Browse State-of-the-Art › Speaker Diarization
Speaker Diarization
93 papers with code · 12 benchmarks · 11 datasets archive 2025-07-28
Speaker Diarization is the task of segmenting and co-indexing audio recordings by speaker. The way the task is commonly defined, the goal is not to identify known speakers, but to co-index segments that are attributed to the same speaker; in other words, diarization implies finding speaker boundaries and grouping segments that belong to the same speaker, and, as a by-product, determining the number of distinct speakers. In combination with speech recognition, diarization enables speaker-attributed speech-to-text transcription.
Source: Improving Diarization Robustness using Diversification, Randomization and the DOVER Algorithm
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
15 leaderboard tables shown for this task, 12 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 15 until expanded.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| CALLHOME (10 rows) | TOLD | TOLD: A Novel Two-Stage Overlap-Aware Framework for Speaker Diarization | code | — | Compare |
| NIST-SRE 2000 (5 rows) | x-vector (MCGAN) | TitaNet: Neural Model for speaker representation with 1D... | code | Syntology ran 0 of 4 samples · 4 unverified | Compare |
| AMI Lapel (4 rows) | TitaNet-M (NME-SC) | TitaNet: Neural Model for speaker representation with 1D... | code | Syntology ran 0 of 4 samples · 4 unverified | Compare |
| AMI MixHeadset (4 rows) | TitaNet-L (NME-SC) | TitaNet: Neural Model for speaker representation with 1D... | code | Syntology ran 0 of 4 samples · 4 unverified | Compare |
| CH109 (4 rows) | TitaNet-S (NME-SC) | TitaNet: Neural Model for speaker representation with 1D... | code | Syntology ran 0 of 4 samples · 4 unverified | Compare |
| DIHARD (3 rows) | pyannote (waveform) | pyannote.audio: neural building blocks for speaker diarization | code | Syntology ran 1 of 1 samples · 0 unverified | Compare |
| ETAPE (3 rows) | pyannote (waveform) | pyannote.audio: neural building blocks for speaker diarization | code | Syntology ran 1 of 1 samples · 0 unverified | Compare |
| AMI (2 rows) | pyannote (waveform) | pyannote.audio: neural building blocks for speaker diarization | code | Syntology ran 1 of 1 samples · 0 unverified | Compare |
| CALLHOME-109 (2 rows) | titanet-s | TitaNet: Neural Model for speaker representation with 1D... | code | Syntology ran 0 of 4 samples · 4 unverified | Compare |
| AliMeeting (1 row) | SOND | Speaker Embedding-aware Neural Diarization: an Efficient Framework... | code | — | Compare |
| DIHARD II (1 row) | UIS-RNN-SML | Supervised online diarization with sample mean loss for multi-domain data | code | — | Compare |
| Hub5'00 CallHome (1 row) | UIS-RNN | Fully Supervised Speaker Diarization | code | — | Compare |
| call_home_american_english_speech (0 rows) | no rows in the archive | — | — | ||
| CALLHOME (NIST-SRE-2000 Disc8) (0 rows) | no rows in the archive | — | — | ||
| DIHARD3-eval (0 rows) | no rows in the archive | — | — | ||
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
11 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Most implemented papers archive 2025-07-28
30 shown of 93 papers with code (328 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.
-
29 Nov 2021 9 repositories listedAudio-visual speaker diarization aims at detecting "who spoke when" using both auditory and visual signals.
-
29 Nov 2021 9 repositories listedAudio-visual speaker diarization aims at detecting "who spoke when" using both auditory and visual signals.
-
28 Oct 2017 4 repositories listedFor many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications.
-
28 Oct 2017 4 repositories listedFor many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications.
-
22 Jun 2023 3 repositories listedSpeech Emotion Recognition (SER) typically relies on utterance-level solutions.
-
22 Jun 2023 3 repositories listedSpeech Emotion Recognition (SER) typically relies on utterance-level solutions.
-
2 Dec 2020 3 repositories listedDIHARD III was the third in a series of speaker diarization challenges intended to improve the robustness of diarization systems to variability in recording equipment, noise conditions, and conversational domain.
-
2 Dec 2020 3 repositories listedDIHARD III was the third in a series of speaker diarization challenges intended to improve the robustness of diarization systems to variability in recording equipment, noise conditions, and conversational domain.
-
20 May 2020 3 repositories listed Syntology ran 0 of 21 samples · 21 unverifiedEnd-to-end speaker diarization for an unknown number of speakers is addressed in this paper.
-
20 May 2020 3 repositories listed Syntology ran 0 of 21 samples · 21 unverifiedEnd-to-end speaker diarization for an unknown number of speakers is addressed in this paper.
-
16 May 2020 3 repositories listedSpeech recognition (ASR) and speaker diarization (SD) models have traditionally been trained separately to produce rich conversation transcripts with speaker labels.
-
16 May 2020 3 repositories listedSpeech recognition (ASR) and speaker diarization (SD) models have traditionally been trained separately to produce rich conversation transcripts with speaker labels.
-
4 Nov 2019 3 repositories listed Syntology ran 1 of 1 samples · 0 unverifiedWe introduce pyannote.
-
4 Nov 2019 3 repositories listed Syntology ran 1 of 1 samples · 0 unverifiedWe introduce pyannote.
-
29 Mar 2024 2 repositories listedWith 3D-Speaker-Toolkit, we establish a new benchmark for multimodal speaker analysis.
-
29 Mar 2024 2 repositories listedWith 3D-Speaker-Toolkit, we establish a new benchmark for multimodal speaker analysis.
-
7 Jan 2024 2 repositories listed Syntology ran 3 of 5 samples · 2 unverifiedIn this paper, we introduce DiarizationLM, a framework to leverage large language models (LLM) to post-process the outputs from a speaker diarization system.
-
7 Jan 2024 2 repositories listed Syntology ran 3 of 5 samples · 2 unverifiedIn this paper, we introduce DiarizationLM, a framework to leverage large language models (LLM) to post-process the outputs from a speaker diarization system.
-
7 Jun 2023 2 repositories listedIn order to tackle both clip-level and frame-level tasks, this paper proposes Audio Teacher-Student Transformer (ATST), with a clip-level version (named ATST-Clip) and a frame-level version (named ATST-Frame),…
-
7 Jun 2023 2 repositories listedIn order to tackle both clip-level and frame-level tasks, this paper proposes Audio Teacher-Student Transformer (ATST), with a clip-level version (named ATST-Clip) and a frame-level version (named ATST-Frame),…
-
8 Nov 2022 2 repositories listedDER is the primary metric to evaluate diarization performance while facing a dilemma: the errors in short utterances or segments tend to be overwhelmed by longer ones.
-
8 Nov 2022 2 repositories listedDER is the primary metric to evaluate diarization performance while facing a dilemma: the errors in short utterances or segments tend to be overwhelmed by longer ones.
-
20 May 2022 2 repositories listedPaddleSpeech is an open-source all-in-one speech toolkit.
-
2 Apr 2022 2 repositories listedHowever, simulated mixtures do not resemble real conversations in many aspects.
-
2 Apr 2022 2 repositories listedHowever, simulated mixtures do not resemble real conversations in many aspects.
-
28 Nov 2021 2 repositories listedIn this paper, we reformulate this task as a single-label prediction problem by encoding the multi-speaker labels with power set.
-
12 Oct 2021 2 repositories listedWe propose a system that combines SAD and a BERT model to perform speaker change detection and speaker role detection (SRD) by chunking ASR transcripts, i.
-
12 Oct 2021 2 repositories listedWe propose a system that combines SAD and a BERT model to perform speaker change detection and speaker role detection (SRD) by chunking ASR transcripts, i.
-
8 Oct 2021 2 repositories listed Syntology ran 0 of 4 samples · 4 unverifiedIn this paper, we propose TitaNet, a novel neural network architecture for extracting speaker representations.
-
8 Oct 2021 2 repositories listed Syntology ran 0 of 4 samples · 4 unverifiedIn this paper, we propose TitaNet, a novel neural network architecture for extracting speaker representations.
Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections