Papers › Delta-Influence: Unlearning Poisons via Influence Functions

Delta-Influence: Unlearning Poisons via Influence Functions

20 Nov 2024arXiv:2411.13731archive 2025-07-28

Wenjie Li, Jiawei Li, Christian Schroeder de Witt, Ameya Prabhu, Amartya Sanyal

Addressing data integrity challenges, such as unlearning the effects of data poisoning after model training, is necessary for the reliable deployment of machine learning models. State-of-the-art influence functions, such as EK-FAC, often fail to accurately attribute abnormal model behavior to the specific poisoned training data responsible for the data poisoning attack. In addition, traditional unlearning algorithms often struggle to effectively remove the influence of poisoned samples, particularly when only a few affected examples can be identified. To address these challenge, we introduce Δ-Influence, a novel approach that leverages influence functions to trace abnormal model behavior back to the responsible poisoned training data using as little as just one poisoned test example. Δ-Influence applies data transformations that sever the link between poisoned training data and compromised test points without significantly affecting clean data. This allows Δ-Influence to detect large negative shifts in influence scores following data transformations, a phenomenon we term as influence collapse, thereby accurately identifying poisoned training data. Unlearning this subset, e.g. through retraining, effectively eliminates the data poisoning. We validate our method across three vision-based poisoning attacks and three datasets, benchmarking against four detection algorithms and five unlearning strategies. We show that Δ-Influence consistently achieves the best unlearning across all settings, showing the promise of influence functions for corrective unlearning. Our code is publicly available at: \url{https://github.com/andyisokay/delta-influence}

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2411.13731")

Code

Syntology Ran 1 of 12 code samples harvested from 2 repositories linked to this paper; 11 have no recorded run. Of those that ran: 1 ran · fixture could not drive it.

By repository: official repository: 1 sample from 1 repository, 0 ran; found in paper text by Syntology: 11 samples from 1 repository, 1 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

andyisokay/delta-influence officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

12 samples harvested; 1 ran; 0 honoured the contract we drafted; 11 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

1ran · fixture could not drive it
11unverified

Licence: 0 of the 12 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 2 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

_Witch andyisokay/delta-influence/forest/witchcoven/witch_base.py official repository unverified MIT (permissive) · 319676f714a216a9 · report
cw_loss Ruby-a07/delta-influence/forest/utils.py found in paper text by Syntology ran · fixture could not drive it MIT (permissive) · 6a5967011bf8de7a · report
average_dicts Ruby-a07/delta-influence/forest/utils.py found in paper text by Syntology unverified MIT (permissive) · ff0cc040d88bde88 · report
check_targets Ruby-a07/delta-influence/forest/victims/training.py found in paper text by Syntology unverified MIT (permissive) · ccb5c504f069d7e6 · report
convnet Ruby-a07/delta-influence/forest/victims/models.py found in paper text by Syntology unverified MIT (permissive) · d2f5607b54df5b75 · report
get_model Ruby-a07/delta-influence/forest/victims/models.py found in paper text by Syntology unverified MIT (permissive) · d180290beeedbcd1 · report
get_optimizers Ruby-a07/delta-influence/forest/victims/training.py found in paper text by Syntology unverified MIT (permissive) · 235c22042629630e · report
linear_model Ruby-a07/delta-influence/forest/victims/models.py found in paper text by Syntology unverified MIT (permissive) · 0fd172b3dd145268 · report
pgd_step Ruby-a07/delta-influence/forest/victims/utils.py found in paper text by Syntology unverified MIT (permissive) · 22091a07a2d0facf · report
run_validation Ruby-a07/delta-influence/forest/victims/training.py found in paper text by Syntology unverified MIT (permissive) · b2c584d7212d6446 · report
system_startup Ruby-a07/delta-influence/forest/utils.py found in paper text by Syntology unverified MIT (permissive) · 120427a416e5f3a1 · report
training_strategy Ruby-a07/delta-influence/forest/victims/optimization_strategy.py found in paper text by Syntology unverified MIT (permissive) · e6a7a6941d029556 · report

Tasks

AttributeBenchmarkingData Poisoning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections