{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/can-speaker-augmentation-improve-multi","title":"Can Speaker Augmentation Improve Multi-Speaker End-to-End TTS?","arxiv_id":"2005.01245","date":"2020-05-04","proceeding":null,"authors":["Erica Cooper","Cheng-I Lai","Yusuke Yasuda","Junichi Yamagishi"],"abstract":"Previous work on speaker adaptation for end-to-end speech synthesis still falls short in speaker similarity. We investigate an orthogonal approach to the current speaker adaptation paradigms, speaker augmentation, by creating artificial speakers and by taking advantage of low-quality data. The base Tacotron2 model is modified to account for the channel and dialect factors inherent in these corpora. In addition, we describe a warm-start training strategy that we adopted for Tacotron2 training. A large-scale listening test is conducted, and a distance metric is adopted to evaluate synthesis of dialects. This is followed by an analysis on synthesis quality, speaker and dialect similarity, and a remark on the effectiveness of our speaker augmentation approach. Audio samples are available online.","url_abs":"https://arxiv.org/abs/2005.01245v2","url_pdf":"https://arxiv.org/pdf/2005.01245v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"can-speaker-augmentation-improve-multi","repo_url":"https://github.com/nii-yamagishilab/multi-speaker-tacotron","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"tasks":[{"task_slug":"speech-synthesis","task_name":"Speech Synthesis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2005.01245","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2005.01245"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nii-yamagishilab/multi-speaker-tacotron","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"unverified":3},"by_repo_kind":{"official":{"samples":3,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"cea1f83e9db28ed8","entry":"expand_abbreviations","repo":"nii-yamagishilab/multi-speaker-tacotron","repo_kind":"official","path":"synthesize_new_texts/datasets/cleaners.py","file_url":"https://github.com/nii-yamagishilab/multi-speaker-tacotron/blob/HEAD/synthesize_new_texts/datasets/cleaners.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"cea1f83e9db28ed8"}},{"code_sha256_prefix":"296274b940cb0b32","entry":"lowercase","repo":"nii-yamagishilab/multi-speaker-tacotron","repo_kind":"official","path":"synthesize_new_texts/datasets/cleaners.py","file_url":"https://github.com/nii-yamagishilab/multi-speaker-tacotron/blob/HEAD/synthesize_new_texts/datasets/cleaners.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"296274b940cb0b32"}},{"code_sha256_prefix":"702bf3362420114b","entry":"text_to_sequence","repo":"nii-yamagishilab/multi-speaker-tacotron","repo_kind":"official","path":"synthesize_new_texts/datasets/text.py","file_url":"https://github.com/nii-yamagishilab/multi-speaker-tacotron/blob/HEAD/synthesize_new_texts/datasets/text.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"702bf3362420114b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}