{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/an-effective-deployment-of-diffusion-lm-for","title":"An Effective Deployment of Diffusion LM for Data Augmentation in Low-Resource Sentiment Classification","arxiv_id":"2409.03203","date":"2024-09-05","proceeding":null,"authors":["Zhuowei Chen","Lianxi Wang","Yuben Wu","Xinfeng Liao","Yujia Tian","Junyang Zhong"],"abstract":"Sentiment classification (SC) often suffers from low-resource challenges such as domain-specific contexts, imbalanced label distributions, and few-shot scenarios. The potential of the diffusion language model (LM) for textual data augmentation (DA) remains unexplored, moreover, textual DA methods struggle to balance the diversity and consistency of new samples. Most DA methods either perform logical modifications or rephrase less important tokens in the original sequence with the language model. In the context of SC, strong emotional tokens could act critically on the sentiment of the whole sequence. Therefore, contrary to rephrasing less important context, we propose DiffusionCLS to leverage a diffusion LM to capture in-domain knowledge and generate pseudo samples by reconstructing strong label-related tokens. This approach ensures a balance between consistency and diversity, avoiding the introduction of noise and augmenting crucial features of datasets. DiffusionCLS also comprises a Noise-Resistant Training objective to help the model generalize. Experiments demonstrate the effectiveness of our method in various low-resource scenarios including domain-specific and domain-general problems. Ablation studies confirm the effectiveness of our framework's modules, and visualization studies highlight optimal deployment conditions, reinforcing our conclusions.","url_abs":"https://arxiv.org/abs/2409.03203v2","url_pdf":"https://arxiv.org/pdf/2409.03203v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"an-effective-deployment-of-diffusion-lm-for","repo_url":"https://github.com/johnnychanv/diffusioncls","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"sentiment-analysis","task_name":"Sentiment Analysis"},{"task_slug":"sentiment-classification","task_name":"Sentiment Classification"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.03203","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.03203"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/JohnnyChanV/DiffusionCLS","reach":{"status":"ok"}}],"summary":{"ran":4},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"733c92ecf8b6ea7b","entry":"DALoss","repo":"JohnnyChanV/DiffusionCLS","repo_kind":"official","path":"Components/CustomModels/Losses.py","file_url":"https://github.com/JohnnyChanV/DiffusionCLS/blob/HEAD/Components/CustomModels/Losses.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"733c92ecf8b6ea7b"}},{"code_sha256_prefix":"5589fc1071be3a08","entry":"getDataLoader","repo":"JohnnyChanV/DiffusionCLS","repo_kind":"official","path":"Components/utils.py","file_url":"https://github.com/JohnnyChanV/DiffusionCLS/blob/HEAD/Components/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5589fc1071be3a08"}},{"code_sha256_prefix":"40b112d5bdbca103","entry":"getLabel2IDFromList","repo":"JohnnyChanV/DiffusionCLS","repo_kind":"official","path":"Components/utils.py","file_url":"https://github.com/JohnnyChanV/DiffusionCLS/blob/HEAD/Components/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"40b112d5bdbca103"}},{"code_sha256_prefix":"0c5fdcc70ca54c26","entry":"sim","repo":"JohnnyChanV/DiffusionCLS","repo_kind":"official","path":"Components/utils.py","file_url":"https://github.com/JohnnyChanV/DiffusionCLS/blob/HEAD/Components/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0c5fdcc70ca54c26"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}