{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2508-21695","title":"Activation Subspaces for Out-of-Distribution Detection","arxiv_id":"2508.21695","date":"2025-08-29","proceeding":"ICCV","authors":["Barış Zöngür","Robin Hesse","Stefan Roth"],"abstract":"To ensure the reliability of deep models in real-world applications, out-of-distribution (OOD) detection methods aim to distinguish samples close to the training distribution (in-distribution, ID) from those farther away (OOD). In this work, we propose a novel OOD detection method that utilizes singular value decomposition of the weight matrix of the classification head to decompose the model's activations into decisive and insignificant components, which contribute maximally, respectively minimally, to the final classifier output. We find that the subspace of insignificant components more effectively distinguishes ID from OOD data than raw activations in regimes of large distribution shifts (Far-OOD). This occurs because the classification objective leaves the insignificant subspace largely unaffected, yielding features that are ''untainted'' by the target classification task. Conversely, in regimes of smaller distribution shifts (Near-OOD), we find that activation shaping methods profit from only considering the decisive subspace, as the insignificant component can cause interference in the activation space. By combining two findings into a single approach, termed ActSub, we achieve state-of-the-art results in various standard OOD benchmarks.","url_abs":"https://arxiv.org/abs/2508.21695","url_pdf":"https://arxiv.org/pdf/2508.21695","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2508.21695","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2508.21695"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/visinf/actsub","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_draft_wrong":1,"unverified":9},"by_repo_kind":{"found_in_text":{"samples":10,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/models/ood_resnet.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/models/ood_resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"3d4d6e083d964b6a","entry":"collect_score","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/ood_utils.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/ood_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3d4d6e083d964b6a"}},{"code_sha256_prefix":"9f21f8b585f91491","entry":"f_cossim","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/methods.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/methods.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9f21f8b585f91491"}},{"code_sha256_prefix":"8359289a41158b1a","entry":"find_c_idx","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/methods.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/methods.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8359289a41158b1a"}},{"code_sha256_prefix":"1b0d32310ed47dd8","entry":"get_curve","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/ood_utils.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/ood_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1b0d32310ed47dd8"}},{"code_sha256_prefix":"adaace94895cc52e","entry":"load_config_yml","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_openood/evaluate_actsub.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_openood/evaluate_actsub.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"adaace94895cc52e"}},{"code_sha256_prefix":"d903f08a285787b0","entry":"mobilenet_v2","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/models/ood_mobilenet.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/models/ood_mobilenet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d903f08a285787b0"}},{"code_sha256_prefix":"8073ec8b6b18b987","entry":"resnet18","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/models/ood_resnet.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/models/ood_resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8073ec8b6b18b987"}},{"code_sha256_prefix":"4c9ea9aacfcac9c2","entry":"resnet50","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/models/ood_resnet.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/models/ood_resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4c9ea9aacfcac9c2"}},{"code_sha256_prefix":"c9265ae58a604189","entry":"split_transform","repo":"visinf/actsub","repo_kind":"found_in_text","path":"actsub_standard/methods.py","file_url":"https://github.com/visinf/actsub/blob/HEAD/actsub_standard/methods.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c9265ae58a604189"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_api"},"syntology_extracted_results":null}