Data Valuation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 53 papers with code (119 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Data Shapley: Equitable Valuation of Data for Machine Learning
  5 Apr 2019 6 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  As data becomes the fuel driving technological and economic growth, a fundamental challenge is how to quantify the value of data in algorithmic predictions and decisions.
• Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attribution
  29 Jan 2024 3 repositories listed Syntology ran 6 of 7 samples · 1 unverified
  Many tasks in explainable machine learning, such as data valuation and feature attribution, perform expensive computation for each data point and are intractable for large datasets.
• The Shapley Value in Machine Learning
  11 Feb 2022 3 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning.
• Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithms
  22 Aug 2019 3 repositories listed Syntology ran 3 of 5 samples · 2 unverified · 5 pointer-only (licence)
  The most surprising result is that for unweighted $K$NN classifiers and regressors, the Shapley value of all N data points can be computed, exactly, in O(NlogN) time -- an exponential improvement on computational…
• 2D-OOB: Attributing Data Contribution Through Joint Valuation Framework
  7 Aug 2024 2 repositories listed
  Data valuation has emerged as a powerful framework for quantifying each datum's contribution to the training of a machine learning model.
• CHG Shapley: Efficient Data Valuation and Selection towards Trustworthy Machine Learning
  17 Jun 2024 2 repositories listed Syntology ran 6 of 8 samples · 2 unverified
  Data Shapley, a landmark study on data valuation, advances this understanding by assessing the contribution of each datum to model performance.
• OpenDataVal: a Unified Benchmark for Data Valuation
  18 Jun 2023 2 repositories listed Syntology ran 6 of 7 samples · 1 unverified
  Assessing the quality and impact of individual data points is critical for improving model performance and mitigating undesirable biases within the training dataset.
• Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Value
  16 Apr 2023 2 repositories listed
  As a result, it has been recognized as infeasible to apply to large datasets.
• CS-Shapley: Class-wise Shapley Values for Data Valuation in Classification
  13 Nov 2022 2 repositories listed
  Our theoretical analysis shows the proposed value function is (essentially) the unique function that satisfies two desirable properties for evaluating data values in classification.
• Data Banzhaf: A Robust Data Valuation Framework for Machine Learning
  30 May 2022 2 repositories listed
  To address this challenge, we introduce the concept of safety margin, which measures the robustness of a data value notion.
• Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning
  26 Oct 2021 2 repositories listed
  Data Shapley has recently been proposed as a principled framework to quantify the contribution of individual datum in machine learning.
• Data Valuation using Reinforcement Learning
  25 Sep 2019 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  To adaptively learn data values jointly with the target task predictor model, we propose a meta learning framework which we name Data Valuation using Reinforcement Learning (DVRL).
• Faithful Group Shapley Value
  25 May 2025 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Data Shapley is an important tool for data valuation, which quantifies the contribution of individual data points to machine learning models.
• Shapley-Guided Utility Learning for Effective Graph Inference Data Valuation
  23 Mar 2025 1 repository listed
  Graph Neural Networks (GNNs) have demonstrated remarkable performance in various graph-based machine learning tasks, yet evaluating the importance of neighbors of testing nodes remains largely unexplored due to the…
• FW-Shapley: Real-time Estimation of Weighted Shapley Values
  9 Mar 2025 1 repository listed
  However, in critical ML applications such as data valuation and feature attribution, the uniform weighting of Shapley values across subset cardinalities leads to unintuitive credit assignments.
• ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Party LLM Data Valuation
  2 Mar 2025 1 repository listed
  Large Language Models (LLMs) heavily rely on high-quality training data, making data valuation crucial for optimizing model performance, especially when working within a limited budget.
• DUPRE: Data Utility Prediction for Efficient Data Valuation
  22 Feb 2025 1 repository listed
  Data valuation is increasingly used in machine learning (ML) to decide the fair compensation for data owners and identify valuable or harmful data for improving ML models.
• Data Valuation using Neural Networks for Efficient Instruction Fine-Tuning
  14 Feb 2025 1 repository listed
  Particularly, recent works have proposed various metrics and algorithms to calculate the influence of data using language models, which do not scale well with large models and datasets.
• Beyond Models! Explainable Data Valuation and Metric Adaption for Recommendation
  12 Feb 2025 1 repository listed
  User behavior records serve as the foundation for recommender systems.
• QLESS: A Quantized Approach for Data Valuation and Selection in Large Language Model Fine-Tuning
  3 Feb 2025 1 repository listed
  Fine-tuning large language models (LLMs) is often constrained by the computational costs of processing massive datasets.
• LossVal: Efficient Data Valuation for Neural Networks
  5 Dec 2024 1 repository listed
  Assessing the importance of individual training samples is a key challenge in machine learning.
• Towards Data Valuation via Asymmetric Data Shapley
  1 Nov 2024 1 repository listed
  The Shapley value, a well-established concept from cooperative game theory, has been widely adopted to assess the contribution of individual data sources in supervised machine learning.
• One Sample Fits All: Approximating All Probabilistic Values Simultaneously and Efficiently
  31 Oct 2024 1 repository listed Syntology ran 0 of 3 samples · 3 unverified · 3 pointer-only (licence)
  Particularly, our one-for-all estimator achieves the fastest convergence rate on Beta Shapley values, including the well-known Shapley value, both theoretically and empirically.
• Data Distribution Valuation
  6 Oct 2024 1 repository listed Syntology ran 12 of 13 samples · 1 unverified
  Data valuation is a class of techniques for quantitatively assessing the value of data for applications like pricing in data marketplaces.
• shapiq: Shapley Interactions for Machine Learning
  2 Oct 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  In this work, we introduce shapiq, an open-source Python package that unifies state-of-the-art algorithms to efficiently compute SVs and any-order SIs in an application-agnostic framework.
• Targeted synthetic data generation for tabular data via hardness characterization
  1 Oct 2024 1 repository listed
  Synthetic data generation has been proven successful in improving model performance and robustness in the context of scarce or low-quality data.
• Influence-based Attributions can be Manipulated
  8 Sep 2024 1 repository listed Syntology ran 4 of 5 samples · 1 unverified · 5 pointer-only (licence)
  Influence Functions are a standard tool for attributing predictions to training data in a principled manner and are widely used in applications such as data valuation and fairness.
• In-Context Probing Approximates Influence Function for Data Valuation
  17 Jul 2024 1 repository listed
  Data valuation quantifies the value of training data, and is used for data attribution (i.
• Redefining Contributions: Shapley-Driven Federated Learning
  1 Jun 2024 1 repository listed Syntology ran 5 of 5 samples · 0 unverified
  This paper proposes a novel contribution assessment method called ShapFed for fine-grained evaluation of participant contributions in FL.
• Scaling Laws for the Value of Individual Data Points in Machine Learning
  30 May 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified
  We introduce a new perspective by investigating scaling behavior for the value of individual data points: we find that a data point's contribution to model's performance shrinks predictably with the size of the dataset…

Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.