{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/non-autoregressive-machine-translation-with-4","title":"Non-autoregressive Machine Translation with Probabilistic Context-free Grammar","arxiv_id":"2311.07941","date":"2023-11-14","proceeding":"NeurIPS 2023 11","authors":["Shangtong Gui","Chenze Shao","Zhengrui Ma","Xishan Zhang","Yunji Chen","Yang Feng"],"abstract":"Non-autoregressive Transformer(NAT) significantly accelerates the inference of neural machine translation. However, conventional NAT models suffer from limited expression power and performance degradation compared to autoregressive (AT) models due to the assumption of conditional independence among target tokens. To address these limitations, we propose a novel approach called PCFG-NAT, which leverages a specially designed Probabilistic Context-Free Grammar (PCFG) to enhance the ability of NAT models to capture complex dependencies among output tokens. Experimental results on major machine translation benchmarks demonstrate that PCFG-NAT further narrows the gap in translation quality between NAT and AT models. Moreover, PCFG-NAT facilitates a deeper understanding of the generated sentences, addressing the lack of satisfactory explainability in neural machine translation.Code is publicly available at https://github.com/ictnlp/PCFG-NAT.","url_abs":"https://arxiv.org/abs/2311.07941v1","url_pdf":"https://arxiv.org/pdf/2311.07941v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"non-autoregressive-machine-translation-with-4","repo_url":"https://github.com/ictnlp/pcfg-nat","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"translation","task_name":"Translation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.07941","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.07941"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ictnlp/pcfg-nat","reach":null}],"summary":{"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c16270c5c7c1f2e7","entry":"logsumexp","repo":"ictnlp/pcfg-nat","repo_kind":"official","path":"fs_plugins/models/glat_decomposed_with_link_two_hands_tri_pcfg.py","file_url":"https://github.com/ictnlp/pcfg-nat/blob/HEAD/fs_plugins/models/glat_decomposed_with_link_two_hands_tri_pcfg.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":2,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c16270c5c7c1f2e7"}},{"code_sha256_prefix":"8c4ed16f84761b33","entry":"viterbi_decoding","repo":"ictnlp/pcfg-nat","repo_kind":"official","path":"fs_plugins/custom_ops/pcfg_loss.py","file_url":"https://github.com/ictnlp/pcfg-nat/blob/HEAD/fs_plugins/custom_ops/pcfg_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c4ed16f84761b33"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}