{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/unleashing-mask-explore-the-intrinsic-out-of","title":"Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability","arxiv_id":"2306.03715","date":"2023-06-06","proceeding":null,"authors":["Jianing Zhu","Hengzhuang Li","Jiangchao Yao","Tongliang Liu","Jianliang Xu","Bo Han"],"abstract":"Out-of-distribution (OOD) detection is an indispensable aspect of secure AI when deploying machine learning models in real-world applications. Previous paradigms either explore better scoring functions or utilize the knowledge of outliers to equip the models with the ability of OOD detection. However, few of them pay attention to the intrinsic OOD detection capability of the given model. In this work, we generally discover the existence of an intermediate stage of a model trained on in-distribution (ID) data having higher OOD detection performance than that of its final stage across different settings, and further identify one critical data-level attribution to be learning with the atypical samples. Based on such insights, we propose a novel method, Unleashing Mask, which aims to restore the OOD discriminative capabilities of the well-trained model with ID data. Our method utilizes a mask to figure out the memorized atypical samples, and then finetune the model or prune it with the introduced mask to forget them. Extensive experiments and analysis demonstrate the effectiveness of our method. The code is available at: https://github.com/tmlr-group/Unleashing-Mask.","url_abs":"https://arxiv.org/abs/2306.03715v1","url_pdf":"https://arxiv.org/pdf/2306.03715v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unleashing-mask-explore-the-intrinsic-out-of","repo_url":"https://github.com/tmlr-group/unleashing-mask","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"out-of-distribution-detection","task_name":"Out-of-Distribution Detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/out-of-distribution-detection-on-imagenet-1k-12","task":"Out-of-Distribution Detection","dataset":"ImageNet-1k vs Curated OODs (avg.)","model":"ODIN+UMAP (ResNet-50)","rank_in_archive_order":12,"of":16,"metrics":{"AUROC":"89.24","FPR95":"40.94"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-distribution-detection-on-imagenet-1k-9","task":"Out-of-Distribution Detection","dataset":"ImageNet-1k vs Places","model":"ODIN+UMAP (ResNet-50)","rank_in_archive_order":15,"of":25,"metrics":{"AUROC":"86.99","FPR95":"50.06"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-distribution-detection-on-imagenet-1k-8","task":"Out-of-Distribution Detection","dataset":"ImageNet-1k vs SUN","model":"ODIN+UMAP (ResNet-50)","rank_in_archive_order":16,"of":22,"metrics":{"AUROC":"86.92","FPR95":"49.69"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-distribution-detection-on-imagenet-1k-10","task":"Out-of-Distribution Detection","dataset":"ImageNet-1k vs Textures","model":"ODIN+UMAP (ResNet-50)","rank_in_archive_order":22,"of":34,"metrics":{"AUROC":"88.35","FPR95":"42.02"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-distribution-detection-on-imagenet-1k-3","task":"Out-of-Distribution Detection","dataset":"ImageNet-1k vs iNaturalist","model":"ODIN+UMAP (ResNet-50)","rank_in_archive_order":17,"of":28,"metrics":{"AUROC":"94.71","FPR95":"21.97"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2306.03715","atlas_url":"https://app.syntology.ai/?focus=2306.03715","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.03715"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tmlr-group/unleashing-mask","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"ran_honours":1,"unverified":5},"by_repo_kind":{"official":{"samples":7,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3853ecdb6fc74451","entry":"fpr_and_fdr_at_recall","repo":"tmlr-group/unleashing-mask","repo_kind":"official","path":"utils/get_scores.py","file_url":"https://github.com/tmlr-group/unleashing-mask/blob/HEAD/utils/get_scores.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3853ecdb6fc74451"}},{"code_sha256_prefix":"d4acb3120a027622","entry":"stable_cumsum","repo":"tmlr-group/unleashing-mask","repo_kind":"official","path":"utils/get_scores.py","file_url":"https://github.com/tmlr-group/unleashing-mask/blob/HEAD/utils/get_scores.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d4acb3120a027622"}},{"code_sha256_prefix":"8a42a6951b0c5e57","entry":"accumulate","repo":"tmlr-group/unleashing-mask","repo_kind":"official","path":"utils/net_utils.py","file_url":"https://github.com/tmlr-group/unleashing-mask/blob/HEAD/utils/net_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a42a6951b0c5e57"}},{"code_sha256_prefix":"177a4abf40724f6e","entry":"arg_to_varname","repo":"tmlr-group/unleashing-mask","repo_kind":"official","path":"configs/parser.py","file_url":"https://github.com/tmlr-group/unleashing-mask/blob/HEAD/configs/parser.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"177a4abf40724f6e"}},{"code_sha256_prefix":"ffc9d7cced6f71fb","entry":"argv_to_vars","repo":"tmlr-group/unleashing-mask","repo_kind":"official","path":"configs/parser.py","file_url":"https://github.com/tmlr-group/unleashing-mask/blob/HEAD/configs/parser.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ffc9d7cced6f71fb"}},{"code_sha256_prefix":"717f5458343a0b63","entry":"get_lr","repo":"tmlr-group/unleashing-mask","repo_kind":"official","path":"utils/net_utils.py","file_url":"https://github.com/tmlr-group/unleashing-mask/blob/HEAD/utils/net_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"717f5458343a0b63"}},{"code_sha256_prefix":"a99f170ebd682af5","entry":"trim_preceding_hyphens","repo":"tmlr-group/unleashing-mask","repo_kind":"official","path":"configs/parser.py","file_url":"https://github.com/tmlr-group/unleashing-mask/blob/HEAD/configs/parser.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a99f170ebd682af5"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}