Papers › CLIPCleaner: Cleaning Noisy Labels with CLIP

CLIPCleaner: Cleaning Noisy Labels with CLIP

19 Aug 2024arXiv:2408.10012archive 2025-07-28

Chen Feng, Georgios Tzimiropoulos, Ioannis Patras

Learning with Noisy labels (LNL) poses a significant challenge for the Machine Learning community. Some of the most widely used approaches that select as clean samples for which the model itself (the in-training model) has high confidence, e.g., `small loss', can suffer from the so called `self-confirmation' bias. This bias arises because the in-training model, is at least partially trained on the noisy labels. Furthermore, in the classification case, an additional challenge arises because some of the label noise is between classes that are visually very similar (`hard noise'). This paper addresses these challenges by proposing a method (\textit{CLIPCleaner}) that leverages CLIP, a powerful Vision-Language (VL) model for constructing a zero-shot classifier for efficient, offline, clean sample selection. This has the advantage that the sample selection is decoupled from the in-training model and that the sample selection is aware of the semantic and visual similarities between the classes due to the way that CLIP is trained. We provide theoretical justifications and empirical evidence to demonstrate the advantages of CLIP for LNL compared to conventional pre-trained models. Compared to current methods that combine iterative sample selection with various techniques, \textit{CLIPCleaner} offers a simple, single-step approach that achieves competitive or superior performance on benchmark datasets. To the best of our knowledge, this is the first time a VL model has been used for sample selection to address the problem of Learning with Noisy Labels (LNL), highlighting their potential in the domain.

PaperPDFCode

Code

mrchenfeng/clipcleaner_acmmm2024 officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Learning with noisy labels

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Learning with noisy labels ANIMAL CLIPCleaner Accuracy 88.85 #3 of 19 Archive leaderboard report
Learning with noisy labels ANIMAL CLIPCleaner ImageNet Pretrained NO #3 of 19 Archive leaderboard report
Learning with noisy labels ANIMAL CLIPCleaner Network Vgg19-BN #3 of 19 Archive leaderboard report
Learning with noisy labels Clothing1M CLIPCleaner Test Accuracy 74.87 #2 of 5 Archive leaderboard report
Learning with noisy labels Red MiniImageNet 20% label noise CLIPCleaner Test Accuracy 61.44 #2 of 4 Archive leaderboard report
Learning with noisy labels Red MiniImageNet 40% label noise CLIPCleaner Test Accuracy 58.42 #2 of 4 Archive leaderboard report
Learning with noisy labels Red MiniImageNet 60% label noise CLIPCleaner Test Accuracy 53.18 #2 of 3 Archive leaderboard report
Learning with noisy labels Red MiniImageNet 80% label noise CLIPCleaner Test Accuracy 43.82 #3 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AWARECLIP

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections