{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/visual-data-diagnosis-and-debiasing-with","title":"Visual Data Diagnosis and Debiasing with Concept Graphs","arxiv_id":"2409.18055","date":"2024-09-26","proceeding":null,"authors":["Rwiddhi Chakraborty","Yinong Wang","Jialu Gao","Runkai Zheng","Cheng Zhang","Fernando de la Torre"],"abstract":"The widespread success of deep learning models today is owed to the curation of extensive datasets significant in size and complexity. However, such models frequently pick up inherent biases in the data during the training process, leading to unreliable predictions. Diagnosing and debiasing datasets is thus a necessity to ensure reliable model performance. In this paper, we present ConBias, a novel framework for diagnosing and mitigating Concept co-occurrence Biases in visual datasets. ConBias represents visual datasets as knowledge graphs of concepts, enabling meticulous analysis of spurious concept co-occurrences to uncover concept imbalances across the whole dataset. Moreover, we show that by employing a novel clique-based concept balancing strategy, we can mitigate these imbalances, leading to enhanced performance on downstream tasks. Extensive experiments show that data augmentation based on a balanced concept distribution augmented by Conbias improves generalization performance across multiple datasets compared to state-of-the-art methods.","url_abs":"https://arxiv.org/abs/2409.18055v2","url_pdf":"https://arxiv.org/pdf/2409.18055v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"visual-data-diagnosis-and-debiasing-with","repo_url":"https://github.com/rwchakra/conbias","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"knowledge-graphs","task_name":"Knowledge Graphs"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.18055","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.18055"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rwchakra/conbias","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":7,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":8,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"581fce689d688527","entry":"compute_clique_values","repo":"rwchakra/conbias","repo_kind":"official","path":"src/make_cliques.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/make_cliques.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"581fce689d688527"}},{"code_sha256_prefix":"7f1086a06a38a87f","entry":"filter_cliques_by_percentile","repo":"rwchakra/conbias","repo_kind":"official","path":"src/make_cliques.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/make_cliques.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f1086a06a38a87f"}},{"code_sha256_prefix":"4b09585add499174","entry":"load_cocogb","repo":"rwchakra/conbias","repo_kind":"official","path":"src/dataloaders.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/dataloaders.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4b09585add499174"}},{"code_sha256_prefix":"d6b38b5a55c98fc9","entry":"load_raw_data","repo":"rwchakra/conbias","repo_kind":"official","path":"src/cutmix_proc.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/cutmix_proc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d6b38b5a55c98fc9"}},{"code_sha256_prefix":"aea5a3b4ff08ee0e","entry":"load_waterbirds","repo":"rwchakra/conbias","repo_kind":"official","path":"src/dataloaders.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/dataloaders.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aea5a3b4ff08ee0e"}},{"code_sha256_prefix":"0756a99508caf42c","entry":"rand_bbox","repo":"rwchakra/conbias","repo_kind":"official","path":"src/cutmix_proc.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/cutmix_proc.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0756a99508caf42c"}},{"code_sha256_prefix":"6bb25299699ce1f4","entry":"remove_class_names","repo":"rwchakra/conbias","repo_kind":"official","path":"src/make_cliques.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/make_cliques.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6bb25299699ce1f4"}},{"code_sha256_prefix":"7a6549645839c35c","entry":"sample_images","repo":"rwchakra/conbias","repo_kind":"official","path":"src/dataloaders.py","file_url":"https://github.com/rwchakra/conbias/blob/HEAD/src/dataloaders.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7a6549645839c35c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}