{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mitigating-unauthorized-speech-synthesis-for","title":"Mitigating Unauthorized Speech Synthesis for Voice Protection","arxiv_id":"2410.20742","date":"2024-10-28","proceeding":null,"authors":["Zhisheng Zhang","Qianyi Yang","Derui Wang","Pengyang Huang","Yuxin Cao","Kai Ye","Jie Hao"],"abstract":"With just a few speech samples, it is possible to perfectly replicate a speaker's voice in recent years, while malicious voice exploitation (e.g., telecom fraud for illegal financial gain) has brought huge hazards in our daily lives. Therefore, it is crucial to protect publicly accessible speech data that contains sensitive information, such as personal voiceprints. Most previous defense methods have focused on spoofing speaker verification systems in timbre similarity but the synthesized deepfake speech is still of high quality. In response to the rising hazards, we devise an effective, transferable, and robust proactive protection technology named Pivotal Objective Perturbation (POP) that applies imperceptible error-minimizing noises on original speech samples to prevent them from being effectively learned for text-to-speech (TTS) synthesis models so that high-quality deepfake speeches cannot be generated. We conduct extensive experiments on state-of-the-art (SOTA) TTS models utilizing objective and subjective metrics to comprehensively evaluate our proposed method. The experimental results demonstrate outstanding effectiveness and transferability across various models. Compared to the speech unclarity score of 21.94% from voice synthesizers trained on samples without protection, POP-protected samples significantly increase it to 127.31%. Moreover, our method shows robustness against noise reduction and data augmentation techniques, thereby greatly reducing potential hazards.","url_abs":"https://arxiv.org/abs/2410.20742v1","url_pdf":"https://arxiv.org/pdf/2410.20742v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mitigating-unauthorized-speech-synthesis-for","repo_url":"https://github.com/wxzyd123/pivotal_objective_perturbation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"face-swapping","task_name":"Face Swapping"},{"task_slug":"speaker-verification","task_name":"Speaker Verification"},{"task_slug":"speech-synthesis","task_name":"Speech Synthesis"},{"task_slug":"text-to-speech","task_name":"Text to Speech"},{"task_slug":"text-to-speech-1","task_name":"text-to-speech"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.20742","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.20742"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wxzyd123/pivotal_objective_perturbation","reach":{"status":"ok"}}],"summary":{"ran_honours":2,"unverified":4},"by_repo_kind":{"official":{"samples":6,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"59ae0708b1e8d94b","entry":"convert_pad_shape","repo":"wxzyd123/pivotal_objective_perturbation","repo_kind":"official","path":"vits/commons.py","file_url":"https://github.com/wxzyd123/pivotal_objective_perturbation/blob/HEAD/vits/commons.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"59ae0708b1e8d94b"}},{"code_sha256_prefix":"a26f85d7c72ef39a","entry":"get_padding","repo":"wxzyd123/pivotal_objective_perturbation","repo_kind":"official","path":"vits/commons.py","file_url":"https://github.com/wxzyd123/pivotal_objective_perturbation/blob/HEAD/vits/commons.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a26f85d7c72ef39a"}},{"code_sha256_prefix":"896f7aae82a62114","entry":"discriminator_loss","repo":"wxzyd123/pivotal_objective_perturbation","repo_kind":"official","path":"vits/losses.py","file_url":"https://github.com/wxzyd123/pivotal_objective_perturbation/blob/HEAD/vits/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"896f7aae82a62114"}},{"code_sha256_prefix":"24e8b4731dc3e070","entry":"feature_loss","repo":"wxzyd123/pivotal_objective_perturbation","repo_kind":"official","path":"vits/losses.py","file_url":"https://github.com/wxzyd123/pivotal_objective_perturbation/blob/HEAD/vits/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"24e8b4731dc3e070"}},{"code_sha256_prefix":"6191fd9efbdd55d4","entry":"generator_loss","repo":"wxzyd123/pivotal_objective_perturbation","repo_kind":"official","path":"vits/losses.py","file_url":"https://github.com/wxzyd123/pivotal_objective_perturbation/blob/HEAD/vits/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6191fd9efbdd55d4"}},{"code_sha256_prefix":"c01a3efb274ff778","entry":"intersperse","repo":"wxzyd123/pivotal_objective_perturbation","repo_kind":"official","path":"vits/commons.py","file_url":"https://github.com/wxzyd123/pivotal_objective_perturbation/blob/HEAD/vits/commons.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c01a3efb274ff778"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}