{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/syntaspeech-syntax-aware-generative","title":"SyntaSpeech: Syntax-Aware Generative Adversarial Text-to-Speech","arxiv_id":"2204.11792","date":"2022-04-25","proceeding":null,"authors":["Zhenhui Ye","Zhou Zhao","Yi Ren","Fei Wu"],"abstract":"The recent progress in non-autoregressive text-to-speech (NAR-TTS) has made fast and high-quality speech synthesis possible. However, current NAR-TTS models usually use phoneme sequence as input and thus cannot understand the tree-structured syntactic information of the input sequence, which hurts the prosody modeling. To this end, we propose SyntaSpeech, a syntax-aware and light-weight NAR-TTS model, which integrates tree-structured syntactic information into the prosody modeling modules in PortaSpeech \\cite{ren2021portaspeech}. Specifically, 1) We build a syntactic graph based on the dependency tree of the input sentence, then process the text encoding with a syntactic graph encoder to extract the syntactic information. 2) We incorporate the extracted syntactic encoding with PortaSpeech to improve the prosody prediction. 3) We introduce a multi-length discriminator to replace the flow-based post-net in PortaSpeech, which simplifies the training pipeline and improves the inference speed, while keeping the naturalness of the generated audio. Experiments on three datasets not only show that the tree-structured syntactic information grants SyntaSpeech the ability to synthesize better audio with expressive prosody, but also demonstrate the generalization ability of SyntaSpeech to adapt to multiple languages and multi-speaker text-to-speech. Ablation studies demonstrate the necessity of each component in SyntaSpeech. Source code and audio samples are available at https://syntaspeech.github.io","url_abs":"https://arxiv.org/abs/2204.11792v1","url_pdf":"https://arxiv.org/pdf/2204.11792v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"syntaspeech-syntax-aware-generative","repo_url":"https://github.com/yerfor/syntaspeech","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2204.11792","atlas_url":"https://app.syntology.ai/?focus=2204.11792","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.11792"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yerfor/syntaspeech","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"ran_honours":1,"ran_draft_wrong":1},"by_repo_kind":{"listed":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a025408166aaff26","entry":"Embedding","repo":"yerfor/syntaspeech","repo_kind":"listed","path":"modules/commons/layers.py","file_url":"https://github.com/yerfor/syntaspeech/blob/HEAD/modules/commons/layers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a025408166aaff26"}},{"code_sha256_prefix":"59ae0708b1e8d94b","entry":"convert_pad_shape","repo":"yerfor/syntaspeech","repo_kind":"listed","path":"modules/commons/rel_transformer.py","file_url":"https://github.com/yerfor/syntaspeech/blob/HEAD/modules/commons/rel_transformer.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"59ae0708b1e8d94b"}},{"code_sha256_prefix":"6d73c67533a98556","entry":"group_hidden_by_segs","repo":"yerfor/syntaspeech","repo_kind":"listed","path":"modules/tts/syntaspeech/syntactic_graph_encoder.py","file_url":"https://github.com/yerfor/syntaspeech/blob/HEAD/modules/tts/syntaspeech/syntactic_graph_encoder.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d73c67533a98556"}},{"code_sha256_prefix":"88bf809d1bc9db4c","entry":"sequence_mask","repo":"yerfor/syntaspeech","repo_kind":"listed","path":"modules/commons/rel_transformer.py","file_url":"https://github.com/yerfor/syntaspeech/blob/HEAD/modules/commons/rel_transformer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"88bf809d1bc9db4c"}},{"code_sha256_prefix":"f1be57b0c4a03d07","entry":"sequence_mask","repo":"yerfor/syntaspeech","repo_kind":"listed","path":"modules/tts/syntaspeech/syntactic_graph_encoder.py","file_url":"https://github.com/yerfor/syntaspeech/blob/HEAD/modules/tts/syntaspeech/syntactic_graph_encoder.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f1be57b0c4a03d07"}},{"code_sha256_prefix":"2173110241f356ce","entry":"shift_1d","repo":"yerfor/syntaspeech","repo_kind":"listed","path":"modules/commons/rel_transformer.py","file_url":"https://github.com/yerfor/syntaspeech/blob/HEAD/modules/commons/rel_transformer.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2173110241f356ce"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}