{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/nusawrites-constructing-high-quality-corpora","title":"NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages","arxiv_id":"2309.10661","date":"2023-09-19","proceeding":null,"authors":["Samuel Cahyawijaya","Holy Lovenia","Fajri Koto","Dea Adhista","Emmanuel Dave","Sarah Oktavianti","Salsabil Maulana Akbar","Jhonson Lee","Nuur Shadieq","Tjeng Wawan Cenggoro","Hanung Wahyuning Linuwih","Bryan Wilie","Galih Pradipta Muridan","Genta Indra Winata","David Moeljadi","Alham Fikri Aji","Ayu Purwarianti","Pascale Fung"],"abstract":"Democratizing access to natural language processing (NLP) technology is crucial, especially for underrepresented and extremely low-resource languages. Previous research has focused on developing labeled and unlabeled corpora for these languages through online scraping and document translation. While these methods have proven effective and cost-efficient, we have identified limitations in the resulting corpora, including a lack of lexical diversity and cultural relevance to local communities. To address this gap, we conduct a case study on Indonesian local languages. We compare the effectiveness of online scraping, human translation, and paragraph writing by native speakers in constructing datasets. Our findings demonstrate that datasets generated through paragraph writing by native speakers exhibit superior quality in terms of lexical diversity and cultural content. In addition, we present the \\datasetname{} benchmark, encompassing 12 underrepresented and extremely low-resource languages spoken by millions of individuals in Indonesia. Our empirical experiment results using existing multilingual large language models conclude the need to extend these models to more underrepresented languages. We release the NusaWrites dataset at https://github.com/IndoNLP/nusa-writes.","url_abs":"https://arxiv.org/abs/2309.10661v2","url_pdf":"https://arxiv.org/pdf/2309.10661v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"nusawrites-constructing-high-quality-corpora","repo_url":"https://github.com/indonlp/nusa-writes","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"document-translation","task_name":"Document Translation"},{"task_slug":"translation","task_name":"Translation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.10661","atlas_url":"https://app.syntology.ai/?focus=2309.10661","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.10661"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/indonlp/nusa-writes","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":7,"ran_honours":1,"ran_draft_wrong":1,"unverified":5},"by_repo_kind":{"official":{"samples":14,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"19a1892a06e4be89","entry":"create_output_directory","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_generation_classic.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_generation_classic.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"19a1892a06e4be89"}},{"code_sha256_prefix":"38ca8eb2c0964a43","entry":"evaluate_classical","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_generation_classic.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_generation_classic.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"38ca8eb2c0964a43"}},{"code_sha256_prefix":"daa8d47d0f9da670","entry":"evaluate_language_model","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_generation.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_generation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"daa8d47d0f9da670"}},{"code_sha256_prefix":"e9c7d263fd12f86d","entry":"get_lr","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_generation.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_generation.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e9c7d263fd12f86d"}},{"code_sha256_prefix":"80e1967386ea09db","entry":"hyperparam_tuning","repo":"indonlp/nusa-writes","repo_kind":"official","path":"boomer/main_boomer.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/boomer/main_boomer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"80e1967386ea09db"}},{"code_sha256_prefix":"2c8f98e551054b67","entry":"metrics_to_string","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_generation.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_generation.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2c8f98e551054b67"}},{"code_sha256_prefix":"d9aa425b275a90da","entry":"to_prompt","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_nlg_prompt.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_nlg_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d9aa425b275a90da"}},{"code_sha256_prefix":"d84b67034badaff8","entry":"to_prompt","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_nlu_prompt.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_nlu_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d84b67034badaff8"}},{"code_sha256_prefix":"eab6642a577f3db1","entry":"translate_one_sentence_panlex","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_generation_classic.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_generation_classic.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"eab6642a577f3db1"}},{"code_sha256_prefix":"dc1ba6a2eff33540","entry":"get_logprobs","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_nlu_prompt.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_nlu_prompt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"dc1ba6a2eff33540"}},{"code_sha256_prefix":"97cce8a19961338b","entry":"load_data","repo":"indonlp/nusa-writes","repo_kind":"official","path":"boomer/main_boomer.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/boomer/main_boomer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"97cce8a19961338b"}},{"code_sha256_prefix":"c9ff0f13e10f8152","entry":"predict_classification","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_nlu_prompt.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_nlu_prompt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c9ff0f13e10f8152"}},{"code_sha256_prefix":"4554d73b7e0f9471","entry":"predict_generation","repo":"indonlp/nusa-writes","repo_kind":"official","path":"main_nlg_prompt.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/main_nlg_prompt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4554d73b7e0f9471"}},{"code_sha256_prefix":"1ee1d7db8057684b","entry":"train_and_test","repo":"indonlp/nusa-writes","repo_kind":"official","path":"boomer/main_boomer.py","file_url":"https://github.com/indonlp/nusa-writes/blob/HEAD/boomer/main_boomer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1ee1d7db8057684b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}