{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/data-distribution-valuation","title":"Data Distribution Valuation","arxiv_id":"2410.04386","date":"2024-10-06","proceeding":null,"authors":["Xinyi Xu","Shuaiqi Wang","Chuan-Sheng Foo","Bryan Kian Hsiang Low","Giulia Fanti"],"abstract":"Data valuation is a class of techniques for quantitatively assessing the value of data for applications like pricing in data marketplaces. Existing data valuation methods define a value for a discrete dataset. However, in many use cases, users are interested in not only the value of the dataset, but that of the distribution from which the dataset was sampled. For example, consider a buyer trying to evaluate whether to purchase data from different vendors. The buyer may observe (and compare) only a small preview sample from each vendor, to decide which vendor's data distribution is most useful to the buyer and purchase. The core question is how should we compare the values of data distributions from their samples? Under a Huber characterization of the data heterogeneity across vendors, we propose a maximum mean discrepancy (MMD)-based valuation method which enables theoretically principled and actionable policies for comparing data distributions from samples. We empirically demonstrate that our method is sample-efficient and effective in identifying valuable data distributions against several existing baselines, on multiple real-world datasets (e.g., network intrusion detection, credit card fraud detection) and downstream applications (classification, regression).","url_abs":"https://arxiv.org/abs/2410.04386v1","url_pdf":"https://arxiv.org/pdf/2410.04386v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"data-distribution-valuation","repo_url":"https://github.com/xinyiys/data_distribution_valuation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"data-valuation","task_name":"Data Valuation"},{"task_slug":"fraud-detection","task_name":"Fraud Detection"},{"task_slug":"intrusion-detection","task_name":"Intrusion Detection"},{"task_slug":"network-intrusion-detection","task_name":"Network Intrusion Detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.04386","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.04386"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/XinyiYS/Data_Distribution_Valuation","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xinyiys/data_distribution_valuation","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":3,"ran_honours":1,"ran":8,"unverified":1},"by_repo_kind":{"official":{"samples":13,"ran":12,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1682bb48a6f46300","entry":"batched_rbf_mmd2","repo":"xinyiys/data_distribution_valuation","repo_kind":"official","path":"mmd.py","file_url":"https://github.com/xinyiys/data_distribution_valuation/blob/HEAD/mmd.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1682bb48a6f46300"}},{"code_sha256_prefix":"a0997c0acc0f3683","entry":"get_MMD_values_uneven","repo":"xinyiys/data_distribution_valuation","repo_kind":"official","path":"mmd.py","file_url":"https://github.com/xinyiys/data_distribution_valuation/blob/HEAD/mmd.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0997c0acc0f3683"}},{"code_sha256_prefix":"f783a3b23476dfc6","entry":"get_extracted","repo":"xinyiys/data_distribution_valuation","repo_kind":"official","path":"run_Ours.py","file_url":"https://github.com/xinyiys/data_distribution_valuation/blob/HEAD/run_Ours.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f783a3b23476dfc6"}},{"code_sha256_prefix":"cbe4794453d07854","entry":"get_mean_se_df","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cbe4794453d07854"}},{"code_sha256_prefix":"0e0b1ef1ccf79eb6","entry":"get_trained_regressor","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"regression/_Ours_utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/regression/_Ours_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0e0b1ef1ccf79eb6"}},{"code_sha256_prefix":"3f594ff441c3d230","entry":"huber","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"data_utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3f594ff441c3d230"}},{"code_sha256_prefix":"fdbaf4694487b065","entry":"huber_regression","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"regression/reg_data_utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/regression/reg_data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fdbaf4694487b065"}},{"code_sha256_prefix":"bb890357a4a87c70","entry":"linear_mmd2","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"mmd.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/mmd.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bb890357a4a87c70"}},{"code_sha256_prefix":"261fa51f4424898d","entry":"load_data","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"261fa51f4424898d"}},{"code_sha256_prefix":"3c8a7d889a9a2cbb","entry":"non_huber","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"data_utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c8a7d889a9a2cbb"}},{"code_sha256_prefix":"48a3b455cac473ed","entry":"rbf_mmd2","repo":"xinyiys/data_distribution_valuation","repo_kind":"official","path":"mmd.py","file_url":"https://github.com/xinyiys/data_distribution_valuation/blob/HEAD/mmd.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"48a3b455cac473ed"}},{"code_sha256_prefix":"04a8c0a05ec0aaec","entry":"set_up_plotting","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"04a8c0a05ec0aaec"}},{"code_sha256_prefix":"62cd4bed729e42af","entry":"assign_data","repo":"XinyiYS/Data_Distribution_Valuation","repo_kind":"official","path":"data_utils.py","file_url":"https://github.com/XinyiYS/Data_Distribution_Valuation/blob/HEAD/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"62cd4bed729e42af"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}