{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2607-29592","title":"TOOD: Task-Aware Out-of-Distribution Score Calibration for Continual Learners","arxiv_id":"2607.29592","date":"2026-07-31","proceeding":null,"authors":["Mostafa ElAraby","Samer B. Nashed","Liam Paull"],"abstract":"The primary challenge of continual learning (CL) systems is to learn new tasks while remaining performant on previously learned tasks. A similarly important though less well-studied aspect of CL systems is their ability to distinguish inputs that are unlikely to come from within the set of tasks the system has already encountered, often called out-of-distribution (OOD) detection. This paper presents several findings related to the dynamics of OOD detection in CL systems, causes of performance degradation over time which we call OOD forgetting (OODF), and proposed mitigation strategies for this degradation. Chiefly, we find the unintuitive result that OODF is only weakly anti-correlated with classification performance on previous tasks, suggesting that the underlying mechanisms producing OODF are distinct. Moreover, this effect is observed for both energy-based and feature-based OOD detection methods. Energy-based detectors suffer a drop in logit scale as additional tasks are learned, which we term the Confidence Gap, while feature-based detectors also degrade under a complementary effect we call Manifold Crowding. Motivated by these observations, we propose TOOD, a training-free post-hoc method that decomposes logits into per-task energy scores and re-calibrates them using replay-buffer statistics. Experiments on CIFAR-10, CIFAR-100, and a 100-task ImageNet-1K stream show that TOOD improves OOD detection performance over uncalibrated energy in most settings and ranks first or second in nine of ten CIFAR configurations, with the largest gains when the confidence gap is most severe. These results suggest that a substantial portion of OOD deterioration in continual learning arises from score miscalibration rather than from a complete loss of discriminative structure.","url_abs":"https://arxiv.org/abs/2607.29592","url_pdf":"https://arxiv.org/pdf/2607.29592","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2607.29592"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mostafaelaraby/tood-continual-ood","reach":null}],"summary":{"ran":8},"by_repo_kind":{"found_in_text":{"samples":8,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"798ae69ccfa89a8a","entry":"auroc","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"analysis/toy_confidence_gap.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/analysis/toy_confidence_gap.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"798ae69ccfa89a8a"}},{"code_sha256_prefix":"707222ad10698f3d","entry":"compute_per_task_energy","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"managers/ood_manager.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/managers/ood_manager.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"707222ad10698f3d"}},{"code_sha256_prefix":"d0e41cdda3938700","entry":"compute_tood_score","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"managers/ood_manager.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/managers/ood_manager.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d0e41cdda3938700"}},{"code_sha256_prefix":"0a9c2c3652d05396","entry":"enable_amp","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"cl_extensions/amp.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/cl_extensions/amp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a9c2c3652d05396"}},{"code_sha256_prefix":"aac9699fbf6aa0a0","entry":"make_blobs","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"analysis/toy_confidence_gap.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/analysis/toy_confidence_gap.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aac9699fbf6aa0a0"}},{"code_sha256_prefix":"f7c325faf019e03d","entry":"normalize_energies","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"managers/ood_manager.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/managers/ood_manager.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f7c325faf019e03d"}},{"code_sha256_prefix":"dc51036cc5070dc8","entry":"select_top_k_labels","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"openood/evaluators/ood_evaluator.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/openood/evaluators/ood_evaluator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc51036cc5070dc8"}},{"code_sha256_prefix":"c4e45a55ba72577a","entry":"split_dataloader","repo":"mostafaelaraby/tood-continual-ood","repo_kind":"found_in_text","path":"openood/evaluators/ood_evaluator.py","file_url":"https://github.com/mostafaelaraby/tood-continual-ood/blob/HEAD/openood/evaluators/ood_evaluator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4e45a55ba72577a"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}