{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/using-trusted-data-to-train-deep-networks-on","title":"Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noise","arxiv_id":"1802.05300","date":"2018-02-14","proceeding":"NeurIPS 2018 12","authors":["Dan Hendrycks","Mantas Mazeika","Duncan Wilson","Kevin Gimpel"],"abstract":"The growing importance of massive datasets used for deep learning makes\nrobustness to label noise a critical property for classifiers to have. Sources\nof label noise include automatic labeling, non-expert labeling, and label\ncorruption by data poisoning adversaries. Numerous previous works assume that\nno source of labels can be trusted. We relax this assumption and assume that a\nsmall subset of the training data is trusted. This enables substantial label\ncorruption robustness performance gains. In addition, particularly severe label\nnoise can be combated by using a set of trusted data with clean labels. We\nutilize trusted data by proposing a loss correction technique that utilizes\ntrusted examples in a data-efficient manner to mitigate the effects of label\nnoise on deep neural network classifiers. Across vision and natural language\nprocessing tasks, we experiment with various label noises at several strengths,\nand show that our method significantly outperforms existing methods.","url_abs":"http://arxiv.org/abs/1802.05300v4","url_pdf":"http://arxiv.org/pdf/1802.05300v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"using-trusted-data-to-train-deep-networks-on","repo_url":"https://github.com/mmazeika/glc","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"data-poisoning","task_name":"Data Poisoning"}],"methods":[{"method_slug":"1cycle","method_name":"1cycle"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1802.05300","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1802.05300"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mmazeika/glc","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":6},"by_repo_kind":{"official":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4a3daeb0c9bd84a9","entry":"calib_err","repo":"mmazeika/glc","repo_kind":"official","path":"CIFAR/train_ours_calibrated.py","file_url":"https://github.com/mmazeika/glc/blob/HEAD/CIFAR/train_ours_calibrated.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4a3daeb0c9bd84a9"}},{"code_sha256_prefix":"74fa122d15c0f3ce","entry":"flip_labels_C","repo":"mmazeika/glc","repo_kind":"official","path":"CIFAR/load_corrupted_data.py","file_url":"https://github.com/mmazeika/glc/blob/HEAD/CIFAR/load_corrupted_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"74fa122d15c0f3ce"}},{"code_sha256_prefix":"f3b4323d27af7924","entry":"flip_labels_C","repo":"mmazeika/glc","repo_kind":"official","path":"MNIST/MNIST_convex_combo.py","file_url":"https://github.com/mmazeika/glc/blob/HEAD/MNIST/MNIST_convex_combo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f3b4323d27af7924"}},{"code_sha256_prefix":"b1bdab97e5bc8f9d","entry":"tune_temp","repo":"mmazeika/glc","repo_kind":"official","path":"CIFAR/train_ours_calibrated.py","file_url":"https://github.com/mmazeika/glc/blob/HEAD/CIFAR/train_ours_calibrated.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b1bdab97e5bc8f9d"}},{"code_sha256_prefix":"ba6749b25e502f54","entry":"uniform_mix_C","repo":"mmazeika/glc","repo_kind":"official","path":"CIFAR/load_corrupted_data.py","file_url":"https://github.com/mmazeika/glc/blob/HEAD/CIFAR/load_corrupted_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ba6749b25e502f54"}},{"code_sha256_prefix":"764472f4327c426b","entry":"uniform_mix_C","repo":"mmazeika/glc","repo_kind":"official","path":"MNIST/MNIST_convex_combo.py","file_url":"https://github.com/mmazeika/glc/blob/HEAD/MNIST/MNIST_convex_combo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"764472f4327c426b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}