{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/simplify-then-translate-automatic","title":"Simplify-then-Translate: Automatic Preprocessing for Black-Box Machine Translation","arxiv_id":"2005.11197","date":"2020-05-22","proceeding":null,"authors":["Sneha Mehta","Bahareh Azarnoush","Boris Chen","Avneesh Saluja","Vinith Misra","Ballav Bihani","Ritwik Kumar"],"abstract":"Black-box machine translation systems have proven incredibly useful for a variety of applications yet by design are hard to adapt, tune to a specific domain, or build on top of. In this work, we introduce a method to improve such systems via automatic pre-processing (APP) using sentence simplification. We first propose a method to automatically generate a large in-domain paraphrase corpus through back-translation with a black-box MT system, which is used to train a paraphrase model that \"simplifies\" the original sentence to be more conducive for translation. The model is used to preprocess source sentences of multiple low-resource language pairs. We show that this preprocessing leads to better translation performance as compared to non-preprocessed source sentences. We further perform side-by-side human evaluation to verify that translations of the simplified sentences are better than the original ones. Finally, we provide some guidance on recommended language pairs for generating the simplification model corpora by investigating the relationship between ease of translation of a language pair (as measured by BLEU) and quality of the resulting simplification model from back-translations of this language pair (as measured by SARI), and tie this into the downstream task of low-resource translation.","url_abs":"https://arxiv.org/abs/2005.11197v2","url_pdf":"https://arxiv.org/pdf/2005.11197v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"translation","task_name":"Translation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2005.11197","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2005.11197"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/tensorflow/tensor2tensor","reach":null}],"summary":{"ran_draft_wrong":2,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"353fd062dc65795a","entry":"_is_match","repo":"tensorflow/tensor2tensor","repo_kind":"found_in_text","path":"tensor2tensor/data_generators/cleaner_en_xx.py","file_url":"https://github.com/tensorflow/tensor2tensor/blob/HEAD/tensor2tensor/data_generators/cleaner_en_xx.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"353fd062dc65795a"}},{"code_sha256_prefix":"22a00fafe356422d","entry":"clean_en_xx_pairs","repo":"tensorflow/tensor2tensor","repo_kind":"found_in_text","path":"tensor2tensor/data_generators/cleaner_en_xx.py","file_url":"https://github.com/tensorflow/tensor2tensor/blob/HEAD/tensor2tensor/data_generators/cleaner_en_xx.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"22a00fafe356422d"}},{"code_sha256_prefix":"939dfa19cfc12eca","entry":"_regex_filter","repo":"tensorflow/tensor2tensor","repo_kind":"found_in_text","path":"tensor2tensor/data_generators/cleaner_en_xx.py","file_url":"https://github.com/tensorflow/tensor2tensor/blob/HEAD/tensor2tensor/data_generators/cleaner_en_xx.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"939dfa19cfc12eca"}},{"code_sha256_prefix":"b5920d740d28d89a","entry":"_split_sentences","repo":"tensorflow/tensor2tensor","repo_kind":"found_in_text","path":"tensor2tensor/data_generators/cleaner_en_xx.py","file_url":"https://github.com/tensorflow/tensor2tensor/blob/HEAD/tensor2tensor/data_generators/cleaner_en_xx.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b5920d740d28d89a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}