{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/chg-shapley-efficient-data-valuation-and","title":"CHG Shapley: Efficient Data Valuation and Selection towards Trustworthy Machine Learning","arxiv_id":"2406.11730","date":"2024-06-17","proceeding":null,"authors":["Huaiguang Cai"],"abstract":"Understanding the decision-making process of machine learning models is crucial for ensuring trustworthy machine learning. Data Shapley, a landmark study on data valuation, advances this understanding by assessing the contribution of each datum to model performance. However, the resource-intensive and time-consuming nature of multiple model retraining poses challenges for applying Data Shapley to large datasets. To address this, we propose the CHG (compound of Hardness and Gradient) utility function, which approximates the utility of each data subset on model performance in every training epoch. By deriving the closed-form Shapley value for each data point using the CHG utility function, we reduce the computational complexity to that of a single model retraining, achieving a quadratic improvement over existing marginal contribution-based methods. We further leverage CHG Shapley for real-time data selection, conducting experiments across three settings: standard datasets, label noise datasets, and class imbalance datasets. These experiments demonstrate its effectiveness in identifying high-value and noisy data. By enabling efficient data valuation, CHG Shapley promotes trustworthy model training through a novel data-centric perspective. Our codes are available at https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation and https://github.com/caihuaiguang/CHG-Shapley-for-Data-Selection.","url_abs":"https://arxiv.org/abs/2406.11730v3","url_pdf":"https://arxiv.org/pdf/2406.11730v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"chg-shapley-efficient-data-valuation-and","repo_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Selection","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"chg-shapley-efficient-data-valuation-and","repo_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"data-valuation","task_name":"Data Valuation"},{"task_slug":"decision-making","task_name":"Decision Making"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.11730","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.11730"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Selection","reach":null}],"summary":{"ran":6,"unverified":2},"by_repo_kind":{"official":{"samples":8,"ran":6,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"09b21e96f9f1145c","entry":"accuracy","repo":"caihuaiguang/CHG-Shapley-for-Data-Valuation","repo_kind":"official","path":"opendataval/metrics.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation/blob/HEAD/opendataval/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09b21e96f9f1145c"}},{"code_sha256_prefix":"e4f775a9a6a730ec","entry":"get_name","repo":"caihuaiguang/CHG-Shapley-for-Data-Valuation","repo_kind":"official","path":"opendataval/util.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation/blob/HEAD/opendataval/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e4f775a9a6a730ec"}},{"code_sha256_prefix":"ac153ea032d1ea3a","entry":"load_mediator_output","repo":"caihuaiguang/CHG-Shapley-for-Data-Valuation","repo_kind":"official","path":"opendataval/util.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation/blob/HEAD/opendataval/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac153ea032d1ea3a"}},{"code_sha256_prefix":"0e01cada769eb741","entry":"neg_l2","repo":"caihuaiguang/CHG-Shapley-for-Data-Valuation","repo_kind":"official","path":"opendataval/metrics.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation/blob/HEAD/opendataval/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0e01cada769eb741"}},{"code_sha256_prefix":"d496216f795f6458","entry":"neg_mse","repo":"caihuaiguang/CHG-Shapley-for-Data-Valuation","repo_kind":"official","path":"opendataval/metrics.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation/blob/HEAD/opendataval/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d496216f795f6458"}},{"code_sha256_prefix":"504db6072fc44357","entry":"set_random_state","repo":"caihuaiguang/CHG-Shapley-for-Data-Valuation","repo_kind":"official","path":"opendataval/util.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation/blob/HEAD/opendataval/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"504db6072fc44357"}},{"code_sha256_prefix":"11ff1d9584441b9a","entry":"shap_value_iterative_selection","repo":"caihuaiguang/CHG-Shapley-for-Data-Selection","repo_kind":"official","path":"shapis_try.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Selection/blob/HEAD/shapis_try.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"11ff1d9584441b9a"}},{"code_sha256_prefix":"5266d8e9025c49d4","entry":"to_numpy","repo":"caihuaiguang/CHG-Shapley-for-Data-Valuation","repo_kind":"official","path":"opendataval/model/api.py","file_url":"https://github.com/caihuaiguang/CHG-Shapley-for-Data-Valuation/blob/HEAD/opendataval/model/api.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5266d8e9025c49d4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}