{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/probabilistic-embeddings-for-speaker","title":"Probabilistic embeddings for speaker diarization","arxiv_id":"2004.04096","date":"2020-04-06","proceeding":null,"authors":["Anna Silnova","Niko Brümmer","Johan Rohdin","Themos Stafylakis","Lukáš Burget"],"abstract":"Speaker embeddings (x-vectors) extracted from very short segments of speech have recently been shown to give competitive performance in speaker diarization. We generalize this recipe by extracting from each speech segment, in parallel with the x-vector, also a diagonal precision matrix, thus providing a path for the propagation of information about the quality of the speech segment into a PLDA scoring backend. These precisions quantify the uncertainty about what the values of the embeddings might have been if they had been extracted from high quality speech segments. The proposed probabilistic embeddings (x-vectors with precisions) are interfaced with the PLDA model by treating the x-vectors as hidden variables and marginalizing them out. We apply the proposed probabilistic embeddings as input to an agglomerative hierarchical clustering (AHC) algorithm to do diarization in the DIHARD'19 evaluation set. We compute the full PLDA likelihood 'by the book' for each clustering hypothesis that is considered by AHC. We do joint discriminative training of the PLDA parameters and of the probabilistic x-vector extractor. We demonstrate accuracy gains relative to a baseline AHC algorithm, applied to traditional xvectors (without uncertainty), and which uses averaging of binary log-likelihood-ratios, rather than by-the-book scoring.","url_abs":"https://arxiv.org/abs/2004.04096v3","url_pdf":"https://arxiv.org/pdf/2004.04096v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"probabilistic-embeddings-for-speaker","repo_url":"https://github.com/bsxfan/probabilistic_embeddings","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"},{"task_slug":"speaker-diarization","task_name":"Speaker Diarization"},{"task_slug":"speaker-diarization","task_name":"speaker-diarization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2004.04096","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.04096"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bsxfan/probabilistic_embeddings","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":21},"by_repo_kind":{"official":{"samples":21,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"84e5da8d52aeb6f6","entry":"PartitionsAsBlocklabels","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/combin/partitions.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/combin/partitions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"84e5da8d52aeb6f6"}},{"code_sha256_prefix":"ff70ee27c442a857","entry":"blocklabels_to_flagvector","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/combin/partitions.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/combin/partitions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff70ee27c442a857"}},{"code_sha256_prefix":"2f2a728ee2342d83","entry":"cs","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/deriv/adtools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/deriv/adtools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2f2a728ee2342d83"}},{"code_sha256_prefix":"1968757262788202","entry":"cs_erfinv","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/erf_tools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/erf_tools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1968757262788202"}},{"code_sha256_prefix":"d504382c533f0747","entry":"erf","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/erf_tools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/erf_tools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d504382c533f0747"}},{"code_sha256_prefix":"3305ad9c04c0c4ba","entry":"erf_and_logderiv","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/erf_tools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/erf_tools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3305ad9c04c0c4ba"}},{"code_sha256_prefix":"43809375625a7a32","entry":"k012e","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/besselk.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/besselk.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"43809375625a7a32"}},{"code_sha256_prefix":"df374dee154cb865","entry":"k0e","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/besselk.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/besselk.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df374dee154cb865"}},{"code_sha256_prefix":"9ef74bb813161dd7","entry":"k1e","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/besselk.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/besselk.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9ef74bb813161dd7"}},{"code_sha256_prefix":"5d6e193b04f14b0a","entry":"labels_to_1hotmatrix","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/combin/partitions.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/combin/partitions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5d6e193b04f14b0a"}},{"code_sha256_prefix":"b89ae8ae46f97e4e","entry":"logprob_alpha","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/prob/crp.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/prob/crp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b89ae8ae46f97e4e"}},{"code_sha256_prefix":"1d37d674cf3f39f3","entry":"logprob_alpha_beta","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/prob/crp.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/prob/crp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1d37d674cf3f39f3"}},{"code_sha256_prefix":"a6571a54ed4fb4d9","entry":"logprob_beta","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/prob/crp.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/prob/crp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a6571a54ed4fb4d9"}},{"code_sha256_prefix":"f64ca25c9836a19a","entry":"logsumexp","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/deriv/adfunctions.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/deriv/adfunctions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f64ca25c9836a19a"}},{"code_sha256_prefix":"8f2cd7ed3c038987","entry":"raug","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/deriv/adtools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/deriv/adtools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8f2cd7ed3c038987"}},{"code_sha256_prefix":"4d6df300e2ac88a3","entry":"rdot","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/deriv/adtools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/deriv/adtools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4d6df300e2ac88a3"}},{"code_sha256_prefix":"d82cc22f6cca675b","entry":"softplus","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/softplus.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/softplus.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d82cc22f6cca675b"}},{"code_sha256_prefix":"e4239541a6ea39c3","entry":"softplusinv","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/special/softplus.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/special/softplus.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e4239541a6ea39c3"}},{"code_sha256_prefix":"e56c64810abf04fe","entry":"squeeze","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/deriv/adfunctions.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/deriv/adfunctions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e56c64810abf04fe"}},{"code_sha256_prefix":"3bcb697e90534a24","entry":"sum2sh","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/deriv/broadcast_adtools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/deriv/broadcast_adtools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3bcb697e90534a24"}},{"code_sha256_prefix":"f606a62d87466fd7","entry":"sum2shape","repo":"bsxfan/probabilistic_embeddings","repo_kind":"official","path":"lib/deriv/broadcast_adtools.py","file_url":"https://github.com/bsxfan/probabilistic_embeddings/blob/HEAD/lib/deriv/broadcast_adtools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f606a62d87466fd7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}