{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/one-shot-voice-conversion-by-separating","title":"One-shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalization","arxiv_id":"1904.05742","date":"2019-04-10","proceeding":null,"authors":["Ju-chieh Chou","Cheng-chieh Yeh","Hung-Yi Lee"],"abstract":"Recently, voice conversion (VC) without parallel data has been successfully adapted to multi-target scenario in which a single model is trained to convert the input voice to many different speakers. However, such model suffers from the limitation that it can only convert the voice to the speakers in the training data, which narrows down the applicable scenario of VC. In this paper, we proposed a novel one-shot VC approach which is able to perform VC by only an example utterance from source and target speaker respectively, and the source and target speaker do not even need to be seen during training. This is achieved by disentangling speaker and content representations with instance normalization (IN). Objective and subjective evaluation shows that our model is able to generate the voice similar to target speaker. In addition to the performance measurement, we also demonstrate that this model is able to learn meaningful speaker representations without any supervision.","url_abs":"https://arxiv.org/abs/1904.05742v4","url_pdf":"https://arxiv.org/pdf/1904.05742v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/jjery2243542/adaptive_voice_conversion","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/Stanwang1210/HW2-1_One_shot_VC","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/augu0093/Voice-Conversion-Project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/augu0093/Voice-Conversion-Project_StarGAN_Danspeech","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/brijmohan/adaptive_voice_conversion","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/cyhuang-tw/AdaIN-VC","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/cyhuang-tw/attack-vc","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/playvoice/grad-svc","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/wdmdev/dtu_voice_conversion_project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/yiftachbeer/AdaIN-VC","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"one-shot-voice-conversion-by-separating","repo_url":"https://github.com/jackaduma/CycleGAN-VC2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"voice-conversion","task_name":"Voice Conversion"}],"methods":[{"method_slug":"instance-normalization","method_name":"Instance Normalization"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1904.05742","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1904.05742"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jackaduma/CycleGAN-VC2","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jjery2243542/adaptive_voice_conversion","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cyhuang-tw/AdaIN-VC","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/augu0093/Voice-Conversion-Project","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yiftachbeer/AdaIN-VC","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/playvoice/grad-svc","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wdmdev/dtu_voice_conversion_project","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/augu0093/Voice-Conversion-Project_StarGAN_Danspeech","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Stanwang1210/HW2-1_One_shot_VC","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cyhuang-tw/attack-vc","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/brijmohan/adaptive_voice_conversion","reach":{"status":"ok"}}],"summary":{"unverified":9},"by_repo_kind":{"official":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"75a00560df788300","entry":"cc","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"utils.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"75a00560df788300"}},{"code_sha256_prefix":"a45438efc97d07d0","entry":"get_data_loader","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"data_utils.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a45438efc97d07d0"}},{"code_sha256_prefix":"1f4ed5944db2a69c","entry":"get_speaker2path","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"preprocess/make_datasets_libri.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/preprocess/make_datasets_libri.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1f4ed5944db2a69c"}},{"code_sha256_prefix":"4d66dbe3ce9ed5bd","entry":"pad_layer","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"model.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4d66dbe3ce9ed5bd"}},{"code_sha256_prefix":"9d60aa7ca2f53c37","entry":"pad_layer_2d","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"model.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9d60aa7ca2f53c37"}},{"code_sha256_prefix":"b3d23676fc738d19","entry":"pixel_shuffle_1d","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"model.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b3d23676fc738d19"}},{"code_sha256_prefix":"4162a1eee2cf318b","entry":"read_filenames","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"preprocess/make_datasets_vctk.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/preprocess/make_datasets_vctk.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4162a1eee2cf318b"}},{"code_sha256_prefix":"15481785b05a3880","entry":"read_paths","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"preprocess/make_datasets_libri.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/preprocess/make_datasets_libri.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"15481785b05a3880"}},{"code_sha256_prefix":"587ed6e8bf7f5b6c","entry":"read_speaker_info","repo":"jjery2243542/adaptive_voice_conversion","repo_kind":"official","path":"preprocess/make_datasets_libri.py","file_url":"https://github.com/jjery2243542/adaptive_voice_conversion/blob/HEAD/preprocess/make_datasets_libri.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"587ed6e8bf7f5b6c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}