{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/robust-data-pruning-under-label-noise-via","title":"Robust Data Pruning under Label Noise via Maximizing Re-labeling Accuracy","arxiv_id":"2311.01002","date":"2023-11-02","proceeding":"NeurIPS 2023 11","authors":[],"abstract":"Data pruning, which aims to downsize a large training set into a small informative subset, is crucial for reducing the enormous computational costs of modern deep learning. Though large-scale data collections invariably contain annotation noise and numerous robust learning methods have been developed, data pruning for the noise-robust learning scenario has received little attention. With state-of-the-art Re-labeling methods that self-correct erroneous labels while training, it is challenging to identify which subset induces the most accurate re-labeling of erroneous labels in the entire training set. In this paper, we formalize the problem of data pruning with re-labeling. We first show that the likelihood of a training example being correctly re-labeled is proportional to the prediction confidence of its neighborhood in the subset. Therefore, we propose a novel data pruning algorithm, Prune4Rel, that finds a subset maximizing the total neighborhood confidence of all training examples, thereby maximizing the re-labeling accuracy and generalization performance. Extensive experiments on four real and one synthetic noisy datasets show that \\algname{} outperforms the baselines with Re-labeling models by up to 9.1% as well as those with a standard model by up to 21.6%.","url_abs":"https://arxiv.org/abs/2311.01002v1","url_pdf":"https://arxiv.org/pdf/2311.01002v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"robust-data-pruning-under-label-noise-via","repo_url":"https://github.com/kaist-dmlab/Prune4Rel","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":"pruning","method_name":"Pruning"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.01002","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.01002"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kaist-dmlab/Prune4Rel","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":10,"ran_fixture":4,"unverified":2},"by_repo_kind":{"official":{"samples":16,"ran":14,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c6e7c3451c85404f","entry":"AutoContrast","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"randaugment.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/randaugment.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c6e7c3451c85404f"}},{"code_sha256_prefix":"0d1a8d6ce2015fc7","entry":"Brightness","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"randaugment.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/randaugment.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0d1a8d6ce2015fc7"}},{"code_sha256_prefix":"32cb3f5760fa593e","entry":"Color","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"randaugment.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/randaugment.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"32cb3f5760fa593e"}},{"code_sha256_prefix":"b92936d1f2ac3e6c","entry":"ShearX","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/augmentations.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/augmentations.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b92936d1f2ac3e6c"}},{"code_sha256_prefix":"008c64b77c4ae4c9","entry":"ShearY","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/augmentations.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/augmentations.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"008c64b77c4ae4c9"}},{"code_sha256_prefix":"ab50d5bbcf589623","entry":"TranslateX","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/augmentations.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/augmentations.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ab50d5bbcf589623"}},{"code_sha256_prefix":"b0f936d4d6ae3b8c","entry":"accuracy","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"utils.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b0f936d4d6ae3b8c"}},{"code_sha256_prefix":"7eabb9b60a9d7a9f","entry":"autoaug2arsaug","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/augmentation_archive.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/augmentation_archive.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7eabb9b60a9d7a9f"}},{"code_sha256_prefix":"40d3c39a403ae1f7","entry":"float_parameter","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/augmentation_archive.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/augmentation_archive.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40d3c39a403ae1f7"}},{"code_sha256_prefix":"20290f0b4273fc17","entry":"get_4class_indices","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/cifar4_LTL.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/cifar4_LTL.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"20290f0b4273fc17"}},{"code_sha256_prefix":"5d960ed6d1bb52d8","entry":"get_train_loss_acc","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"utils.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5d960ed6d1bb52d8"}},{"code_sha256_prefix":"7900a3a6deef908b","entry":"int_parameter","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/augmentation_archive.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/augmentation_archive.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7900a3a6deef908b"}},{"code_sha256_prefix":"fa5017994bfee770","entry":"test","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"utils.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa5017994bfee770"}},{"code_sha256_prefix":"ef49e82a7403eee1","entry":"unpickle","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"load_noise_data.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/load_noise_data.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef49e82a7403eee1"}},{"code_sha256_prefix":"6cc485cf20ef31bf","entry":"CIFAR4_LTL","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"deepcore/datasets/cifar4_LTL.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/deepcore/datasets/cifar4_LTL.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6cc485cf20ef31bf"}},{"code_sha256_prefix":"6e9644d1e3dfa611","entry":"get_asym_cifar100","repo":"kaist-dmlab/Prune4Rel","repo_kind":"official","path":"load_noise_data.py","file_url":"https://github.com/kaist-dmlab/Prune4Rel/blob/HEAD/load_noise_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6e9644d1e3dfa611"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}