{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-14222","title":"Learning the Context of Errors: Black-Box Online Adaptation of Time Series Foundation Models","arxiv_id":"2606.14222","date":"2026-06-12","proceeding":null,"authors":["Xilin Dai","Yiding Liu","Hongjie Xia","Yifan Hu","Zewei Dong","Jiang-Ming Yang","Qiang Xu"],"abstract":"The rapid evolution of Time Series Foundation Models (TSFMs) has advanced zero-shot forecasting across diverse domains. Inspired by the current form of Large Language Models, future TSFMs may be offered as commercialized, closed-source API services. However, many existing online adaptation methods still rely on white-box access for parameter fine-tuning or gradient backpropagation. This paradigm mismatch raises a question: In black-box online adaptation for TSFMs, what should we learn? We answer this with an insight: the predictive errors of the base model are conditioned on both the input and output of the base model (i.e., the context of errors). To validate this insight, we propose ORCA (Online Residual Contextual Adaptation). We conduct extensive experiments across 5 state-of-the-art TSFMs and 8 datasets to demonstrate the effectiveness of our approach. Furthermore, through ablation studies, we quantitatively analyze the impact of different adapter learning hypotheses on the final adaptation performance in black-box online adaptation. Code available at https://github.com/Fifthky/ORCA.","url_abs":"https://arxiv.org/abs/2606.14222","url_pdf":"https://arxiv.org/pdf/2606.14222","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.14222","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.14222"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Fifthky/ORCA","reach":null}],"summary":{"ran":4,"ran_honours":1,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"34e2f25708d0d922","entry":"AttnConfig","repo":"Fifthky/ORCA","repo_kind":"found_in_text","path":"core/refiner_attn.py","file_url":"https://github.com/Fifthky/ORCA/blob/HEAD/core/refiner_attn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"34e2f25708d0d922"}},{"code_sha256_prefix":"5e87ade15adc6f84","entry":"AttnCore","repo":"Fifthky/ORCA","repo_kind":"found_in_text","path":"core/refiner_attn.py","file_url":"https://github.com/Fifthky/ORCA/blob/HEAD/core/refiner_attn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e87ade15adc6f84"}},{"code_sha256_prefix":"ea28ec451a5d07bc","entry":"DropPath","repo":"Fifthky/ORCA","repo_kind":"found_in_text","path":"core/refiner_attn.py","file_url":"https://github.com/Fifthky/ORCA/blob/HEAD/core/refiner_attn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ea28ec451a5d07bc"}},{"code_sha256_prefix":"02361505a3ab9cea","entry":"PatchChannelMixerBlock","repo":"Fifthky/ORCA","repo_kind":"found_in_text","path":"core/refiner_attn.py","file_url":"https://github.com/Fifthky/ORCA/blob/HEAD/core/refiner_attn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"02361505a3ab9cea"}},{"code_sha256_prefix":"2c40d75eb9548034","entry":"sanitize_tensor","repo":"Fifthky/ORCA","repo_kind":"found_in_text","path":"core/refiner_attn.py","file_url":"https://github.com/Fifthky/ORCA/blob/HEAD/core/refiner_attn.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2c40d75eb9548034"}},{"code_sha256_prefix":"e16388b6350b2e6b","entry":"OnlineRefinerAttn","repo":"Fifthky/ORCA","repo_kind":"found_in_text","path":"core/refiner_attn.py","file_url":"https://github.com/Fifthky/ORCA/blob/HEAD/core/refiner_attn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e16388b6350b2e6b"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}