{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-comprehensive-survey-with-critical-analysis","title":"A Comprehensive Survey with Critical Analysis for Deepfake Speech Detection","arxiv_id":"2409.15180","date":"2024-09-23","proceeding":null,"authors":["Lam Pham","Phat Lam","Dat Tran","Hieu Tang","Tin Nguyen","Alexander Schindler","Florian Skopik","Alexander Polonsky","Canh Vu"],"abstract":"Thanks to advancements in deep learning, speech generation systems now power a variety of real-world applications, such as text-to-speech for individuals with speech disorders, voice chatbots in call centers, cross-linguistic speech translation, etc. While these systems can autonomously generate human-like speech and replicate specific voices, they also pose risks when misused for malicious purposes. This motivates the research community to develop models for detecting synthesized speech (e.g., fake speech) generated by deep-learning-based models, referred to as the Deepfake Speech Detection task. As the Deepfake Speech Detection task has emerged in recent years, there are not many survey papers proposed for this task. Additionally, existing surveys for the Deepfake Speech Detection task tend to summarize techniques used to construct a Deepfake Speech Detection system rather than providing a thorough analysis. This gap motivated us to conduct a comprehensive survey, providing a critical analysis of the challenges and developments in Deepfake Speech Detection. Our survey is innovatively structured, offering an in-depth analysis of current challenge competitions, public datasets, and the deep-learning techniques that provide enhanced solutions to address existing challenges in the field. From our analysis, we propose hypotheses on leveraging and combining specific deep learning techniques to improve the effectiveness of Deepfake Speech Detection systems. Beyond conducting a survey, we perform extensive experiments to validate these hypotheses and propose a highly competitive model for the task of Deepfake Speech Detection. Given the analysis and the experimental results, we finally indicate potential and promising research directions for the Deepfake Speech Detection task.","url_abs":"https://arxiv.org/abs/2409.15180v4","url_pdf":"https://arxiv.org/pdf/2409.15180v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"a-comprehensive-survey-with-critical-analysis","repo_url":"https://github.com/tamlhp/dfd_benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.15180","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.15180"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tamlhp/dfd_benchmark","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":15},"by_repo_kind":{"listed":{"samples":16,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"bedff51745d2cf84","entry":"l2normalize","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/self_attention.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/self_attention.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bedff51745d2cf84"}},{"code_sha256_prefix":"2665a2657815a013","entry":"detect_cnn","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/detect_torch.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/detect_torch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2665a2657815a013"}},{"code_sha256_prefix":"a03acdb32037f2a6","entry":"detect_dualcnn","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/detect_torch.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/detect_torch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a03acdb32037f2a6"}},{"code_sha256_prefix":"897a5d87d28bfaed","entry":"eval_train","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/train_torch.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/train_torch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"897a5d87d28bfaed"}},{"code_sha256_prefix":"972aaa34a23ce98a","entry":"get_generate","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/data_generate.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/data_generate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"972aaa34a23ce98a"}},{"code_sha256_prefix":"cb744852c96e8bf9","entry":"get_random_eraser","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"tf_model/eval_tf.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/tf_model/eval_tf.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cb744852c96e8bf9"}},{"code_sha256_prefix":"39e302283da569f7","entry":"get_val_generate","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/data_generate.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/data_generate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"39e302283da569f7"}},{"code_sha256_prefix":"1e986746fb9c6eab","entry":"image_contrast_adjusment","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"tf_model/eval_tf.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/tf_model/eval_tf.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e986746fb9c6eab"}},{"code_sha256_prefix":"ce6fddcb44354b77","entry":"load_image","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"detect_img.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/detect_img.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce6fddcb44354b77"}},{"code_sha256_prefix":"dc30c4178236c621","entry":"load_model","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"detect_img.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/detect_img.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc30c4178236c621"}},{"code_sha256_prefix":"1b9ccfc33c685a48","entry":"local_nn","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/local_nn.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/local_nn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b9ccfc33c685a48"}},{"code_sha256_prefix":"f011fb6c6bddc505","entry":"make_weights_for_balanced_classes","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/data_generate.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/data_generate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f011fb6c6bddc505"}},{"code_sha256_prefix":"b79e8df819e9c4fb","entry":"mnasnet","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/model_cnn_pytorch.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/model_cnn_pytorch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b79e8df819e9c4fb"}},{"code_sha256_prefix":"90cd746335dedf20","entry":"resnet2D56","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/local_nn.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/local_nn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"90cd746335dedf20"}},{"code_sha256_prefix":"c1172f84b92d9080","entry":"resnext101","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/model_cnn_pytorch.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/model_cnn_pytorch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1172f84b92d9080"}},{"code_sha256_prefix":"2cd25c9ced119225","entry":"resnext50","repo":"tamlhp/dfd_benchmark","repo_kind":"listed","path":"pytorch_model/model_cnn_pytorch.py","file_url":"https://github.com/tamlhp/dfd_benchmark/blob/HEAD/pytorch_model/model_cnn_pytorch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2cd25c9ced119225"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}