{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/feedback-guided-data-synthesis-for-imbalanced","title":"Feedback-guided Data Synthesis for Imbalanced Classification","arxiv_id":"2310.00158","date":"2023-09-29","proceeding":null,"authors":["Reyhane Askari Hemmat","Mohammad Pezeshki","Florian Bordes","Michal Drozdzal","Adriana Romero-Soriano"],"abstract":"Current status quo in machine learning is to use static datasets of real images for training, which often come from long-tailed distributions. With the recent advances in generative models, researchers have started augmenting these static datasets with synthetic data, reporting moderate performance improvements on classification tasks. We hypothesize that these performance gains are limited by the lack of feedback from the classifier to the generative model, which would promote the usefulness of the generated samples to improve the classifier's performance. In this work, we introduce a framework for augmenting static datasets with useful synthetic samples, which leverages one-shot feedback from the classifier to drive the sampling of the generative model. In order for the framework to be effective, we find that the samples must be close to the support of the real data of the task at hand, and be sufficiently diverse. We validate three feedback criteria on a long-tailed dataset (ImageNet-LT) as well as a group-imbalanced dataset (NICO++). On ImageNet-LT, we achieve state-of-the-art results, with over 4 percent improvement on underrepresented classes while being twice efficient in terms of the number of generated synthetic samples. NICO++ also enjoys marked boosts of over 5 percent in worst group accuracy. With these results, our framework paves the path towards effectively leveraging state-of-the-art text-to-image models as data sources that can be queried to improve downstream applications.","url_abs":"https://arxiv.org/abs/2310.00158v2","url_pdf":"https://arxiv.org/pdf/2310.00158v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"feedback-guided-data-synthesis-for-imbalanced","repo_url":"https://github.com/facebookresearch/feedback-guided-data-synthesis","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"imbalanced-classification","task_name":"imbalanced classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.00158","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.00158"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/feedback-guided-data-synthesis","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":1,"unverified":3},"by_repo_kind":{"official":{"samples":4,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"d4290215d608d171","entry":"save_image","repo":"facebookresearch/feedback-guided-data-synthesis","repo_kind":"official","path":"utils_gen.py","file_url":"https://github.com/facebookresearch/feedback-guided-data-synthesis/blob/HEAD/utils_gen.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d4290215d608d171"}},{"code_sha256_prefix":"1005a2401376bffe","entry":"generate_single_sample","repo":"facebookresearch/feedback-guided-data-synthesis","repo_kind":"official","path":"utils_gen.py","file_url":"https://github.com/facebookresearch/feedback-guided-data-synthesis/blob/HEAD/utils_gen.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"1005a2401376bffe"}},{"code_sha256_prefix":"5f8c4b3fc2498b7a","entry":"get_classifier","repo":"facebookresearch/feedback-guided-data-synthesis","repo_kind":"official","path":"utils_gen.py","file_url":"https://github.com/facebookresearch/feedback-guided-data-synthesis/blob/HEAD/utils_gen.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5f8c4b3fc2498b7a"}},{"code_sha256_prefix":"11a653cd1b423558","entry":"pre_populate_csv","repo":"facebookresearch/feedback-guided-data-synthesis","repo_kind":"official","path":"generate_csvs_offline.py","file_url":"https://github.com/facebookresearch/feedback-guided-data-synthesis/blob/HEAD/generate_csvs_offline.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"11a653cd1b423558"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}