{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/abex-data-augmentation-for-low-resource-nlu","title":"ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptions","arxiv_id":"2406.04286","date":"2024-06-06","proceeding":null,"authors":["Sreyan Ghosh","Utkarsh Tyagi","Sonal Kumar","C. K. Evuru","S Ramaneswaran","S Sakshi","Dinesh Manocha"],"abstract":"We present ABEX, a novel and effective generative data augmentation methodology for low-resource Natural Language Understanding (NLU) tasks. ABEX is based on ABstract-and-EXpand, a novel paradigm for generating diverse forms of an input document -- we first convert a document into its concise, abstract description and then generate new documents based on expanding the resultant abstraction. To learn the task of expanding abstract descriptions, we first train BART on a large-scale synthetic dataset with abstract-document pairs. Next, to generate abstract descriptions for a document, we propose a simple, controllable, and training-free method based on editing AMR graphs. ABEX brings the best of both worlds: by expanding from abstract representations, it preserves the original semantic properties of the documents, like style and meaning, thereby maintaining alignment with the original label and data distribution. At the same time, the fundamental process of elaborating on abstract descriptions facilitates diverse generations. We demonstrate the effectiveness of ABEX on 4 NLU tasks spanning 12 datasets and 4 low-resource settings. ABEX outperforms all our baselines qualitatively with improvements of 0.04% - 38.8%. Qualitatively, ABEX outperforms all prior methods from literature in terms of context and length diversity.","url_abs":"https://arxiv.org/abs/2406.04286v1","url_pdf":"https://arxiv.org/pdf/2406.04286v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"abex-data-augmentation-for-low-resource-nlu","repo_url":"https://github.com/sreyan88/abex","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"natural-language-understanding","task_name":"Natural Language Understanding"}],"methods":[{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bart","method_name":"BART"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.04286","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.04286"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sreyan88/abex","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/Sreyan88/ABEX","reach":{"status":"ok"}}],"summary":{"ran":7},"by_repo_kind":{"official":{"samples":7,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"ba07f383a07544ed","entry":"calculate_depth","repo":"Sreyan88/ABEX","repo_kind":"official","path":"src/filter_amr.py","file_url":"https://github.com/Sreyan88/ABEX/blob/HEAD/src/filter_amr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ba07f383a07544ed"}},{"code_sha256_prefix":"81a312d66eb6a8e4","entry":"custom_collate","repo":"Sreyan88/ABEX","repo_kind":"official","path":"src/hf_consistency.py","file_url":"https://github.com/Sreyan88/ABEX/blob/HEAD/src/hf_consistency.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"81a312d66eb6a8e4"}},{"code_sha256_prefix":"de00496a662b41ba","entry":"extract_backreferences","repo":"Sreyan88/ABEX","repo_kind":"official","path":"amr_parser_spring/spring_amr/modeling_bart.py","file_url":"https://github.com/Sreyan88/ABEX/blob/HEAD/amr_parser_spring/spring_amr/modeling_bart.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"de00496a662b41ba"}},{"code_sha256_prefix":"a4b272be87b24b67","entry":"remove_invalid_parentheses","repo":"Sreyan88/ABEX","repo_kind":"official","path":"src/filter_amr.py","file_url":"https://github.com/Sreyan88/ABEX/blob/HEAD/src/filter_amr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a4b272be87b24b67"}},{"code_sha256_prefix":"1061414be3ce5f7c","entry":"rename_columns","repo":"Sreyan88/ABEX","repo_kind":"official","path":"src/gold_classifier.py","file_url":"https://github.com/Sreyan88/ABEX/blob/HEAD/src/gold_classifier.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1061414be3ce5f7c"}},{"code_sha256_prefix":"98580ffff99a5e66","entry":"replace_multiple_spaces","repo":"Sreyan88/ABEX","repo_kind":"official","path":"src/filter_amr.py","file_url":"https://github.com/Sreyan88/ABEX/blob/HEAD/src/filter_amr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"98580ffff99a5e66"}},{"code_sha256_prefix":"5e060ba08fb272f3","entry":"tokenize_sentence","repo":"Sreyan88/ABEX","repo_kind":"official","path":"amr_parser_spring/bin/eval_bleu.py","file_url":"https://github.com/Sreyan88/ABEX/blob/HEAD/amr_parser_spring/bin/eval_bleu.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e060ba08fb272f3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}