{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-14254","title":"ZOTTA: Test-Time Adaptation with Gradient-Free Zeroth-Order Optimization","arxiv_id":"2603.14254","date":"2026-03-15","proceeding":null,"authors":["Ronghao Zhang","Shuaicheng Niu","Qi Deng","Yanjie Dong","Jian Chen","Runhao Zeng"],"abstract":"Test-time adaptation (TTA) aims to improve model robustness under distribution shifts by adapting to unlabeled test data, but most existing methods rely on backpropagation (BP), which is computationally costly and incompatible with non-differentiable models such as quantized models, limiting practical deployment on numerous edge devices. Recent BP-free approaches alleviate overhead but remain either architecture-specific or limited in optimization capacity to handle high-dimensional models. We propose ZOTTA, a fully BP-free TTA framework that performs efficient adaptation using only forward passes via Zeroth-Order Optimization (ZOO). While ZOO is theoretically appealing, naive application leads to slow convergence under high-dimensional parameter spaces and unstable optimization due to the lack of labels. ZOTTA overcomes these challenges through 1) Distribution-Robust Layer Selection, which automatically identifies and freezes layers that already extract distribution-invariant features, updating only domain-sensitive layers to reduce the optimization dimensionality and accelerate convergence; 2) Spatial Feature Aggregation Alignment, which stabilizes ZOO by aligning globally aggregated spatial features between source and target to reduce gradient variance. Together, these components enable architecture-agnostic and stable BP-free adaptation. Extensive experiments on ImageNet-C/R/Sketch/A show that ZOTTA outperforms or matches BP-based methods, e.g., it reduces memory usage by 84% and improves accuracy by 3.9% over SAR on ImageNet-C. Code:https://github.com/Zhang-Ronghao/zotta.","url_abs":"https://arxiv.org/abs/2603.14254","url_pdf":"https://arxiv.org/pdf/2603.14254","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2603.14254","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.14254"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Zhang-Ronghao/zotta","reach":null}],"summary":{"ran":3,"ran_draft_wrong":4,"ran_fixture":1,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":12,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"781987d0331d9284","entry":"MinMaxQuantMatMul","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"781987d0331d9284"}},{"code_sha256_prefix":"9bc6c3b39df20576","entry":"PTQSLBatchingQuantMatMul","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9bc6c3b39df20576"}},{"code_sha256_prefix":"3684dcba774a85a4","entry":"PTQSLQuantMatMul","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3684dcba774a85a4"}},{"code_sha256_prefix":"9400434cc4986920","entry":"_select_params_by_patterns","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9400434cc4986920"}},{"code_sha256_prefix":"e2479e1468ca9ffe","entry":"collect_norm_params","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e2479e1468ca9ffe"}},{"code_sha256_prefix":"0894f6cd7b5e7b5f","entry":"copy_model","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0894f6cd7b5e7b5f"}},{"code_sha256_prefix":"3aeaee983277fbf8","entry":"forward_and_get_loss","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3aeaee983277fbf8"}},{"code_sha256_prefix":"1bdb21f20be90a8f","entry":"softmax_entropy","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1bdb21f20be90a8f"}},{"code_sha256_prefix":"f6520a61abd71dc5","entry":"SoSPTQSLBatchingQuantMatMul","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6520a61abd71dc5"}},{"code_sha256_prefix":"1e8bb42d7e0c055b","entry":"ZOTTA","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e8bb42d7e0c055b"}},{"code_sha256_prefix":"c428502ddc035c2b","entry":"collect_selected_norm_params","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c428502ddc035c2b"}},{"code_sha256_prefix":"7b969394a74a96c4","entry":"load_model","repo":"Zhang-Ronghao/zotta","repo_kind":"found_in_text","path":"tta_library/zotta.py","file_url":"https://github.com/Zhang-Ronghao/zotta/blob/HEAD/tta_library/zotta.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7b969394a74a96c4"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}