Papers › Relabeling Minimal Training Subset to Flip a Prediction

Relabeling Minimal Training Subset to Flip a Prediction

22 May 2023arXiv:2305.12809archive 2025-07-28

Jinghan Yang, Linjie Xu, Lequan Yu

When facing an unsatisfactory prediction from a machine learning model, users can be interested in investigating the underlying reasons and exploring the potential for reversing the outcome. We ask: To flip the prediction on a test point xₜ, how to identify the smallest training subset 𝒮ₜ that we need to relabel? We propose an efficient algorithm to identify and relabel such a subset via an extended influence function for binary classification models with convex loss. We find that relabeling fewer than 2% of the training points can always flip a prediction. This mechanism can serve multiple purposes: (1) providing an approach to challenge a model prediction by altering training points; (2) evaluating model robustness with the cardinality of the subset (i.e., |𝒮ₜ|); we show that |𝒮ₜ| is highly related to the noise ratio in the training set and |𝒮ₜ| is correlated with but complementary to predicted probabilities; and (3) revealing training points lead to group attribution bias. To the best of our knowledge, we are the first to investigate identifying and relabeling the minimal training subset required to flip a given prediction.

PaperPDFCode

Code

ecielyang/relabeling officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Binary ClassificationPrediction

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

FLIPTest

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections