{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/test-time-adaptive-vision-and-language","title":"Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigation","arxiv_id":"2311.13209","date":"2023-11-22","proceeding":null,"authors":["Junyu Gao","Xuan Yao","Changsheng Xu"],"abstract":"The ability to accurately comprehend natural language instructions and navigate to the target location is essential for an embodied agent. Such agents are typically required to execute user instructions in an online manner, leading us to explore the use of unlabeled test samples for effective online model adaptation. However, for online Vision-and-Language Navigation (VLN), due to the intrinsic nature of inter-sample online instruction execution and intra-sample multi-step action decision, frequent updates can result in drastic changes in model parameters, while occasional updates can make the model ill-equipped to handle dynamically changing environments. Therefore, we propose a Fast-Slow Test-Time Adaptation (FSTTA) approach for online VLN by performing joint decomposition-accumulation analysis for both gradients and parameters in a unified framework. Extensive experiments show that our method obtains impressive performance gains on four popular benchmarks. Code is available at https://github.com/Feliciaxyao/ICML2024-FSTTA.","url_abs":"https://arxiv.org/abs/2311.13209v4","url_pdf":"https://arxiv.org/pdf/2311.13209v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"test-time-adaptive-vision-and-language","repo_url":"https://github.com/feliciaxyao/icml2024-fstta","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"navigate","task_name":"Navigate"},{"task_slug":"test-time-adaptation","task_name":"Test-time Adaptation"},{"task_slug":"vision-and-language-navigation","task_name":"Vision and Language Navigation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.13209","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.13209"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/feliciaxyao/icml2024-fstta","reach":null}],"summary":{"ran":1,"ran_draft_wrong":4,"ran_fixture":1},"by_repo_kind":{"official":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"909d885bd5d10e3c","entry":"FAST","repo":"feliciaxyao/icml2024-fstta","repo_kind":"official","path":"map_nav_src/models/FSTTA.py","file_url":"https://github.com/feliciaxyao/icml2024-fstta/blob/HEAD/map_nav_src/models/FSTTA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"909d885bd5d10e3c"}},{"code_sha256_prefix":"f521ffe4bf27286f","entry":"compute_concordant_grad_and_trace","repo":"Feliciaxyao/ICML2024-FSTTA","repo_kind":"official","path":"map_nav_src/models/FSTTA.py","file_url":"https://github.com/Feliciaxyao/ICML2024-FSTTA/blob/HEAD/map_nav_src/models/FSTTA.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f521ffe4bf27286f"}},{"code_sha256_prefix":"d5ec55d57982cbe9","entry":"compute_concordant_grad_and_trace","repo":"feliciaxyao/icml2024-fstta","repo_kind":"official","path":"map_nav_src/models/FSTTA.py","file_url":"https://github.com/feliciaxyao/icml2024-fstta/blob/HEAD/map_nav_src/models/FSTTA.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d5ec55d57982cbe9"}},{"code_sha256_prefix":"9a1c45364d298354","entry":"fast_forward_and_adapt","repo":"Feliciaxyao/ICML2024-FSTTA","repo_kind":"official","path":"map_nav_src/models/FSTTA.py","file_url":"https://github.com/Feliciaxyao/ICML2024-FSTTA/blob/HEAD/map_nav_src/models/FSTTA.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9a1c45364d298354"}},{"code_sha256_prefix":"6f4c48560fa19beb","entry":"fast_forward_and_adapt","repo":"feliciaxyao/icml2024-fstta","repo_kind":"official","path":"map_nav_src/models/FSTTA.py","file_url":"https://github.com/feliciaxyao/icml2024-fstta/blob/HEAD/map_nav_src/models/FSTTA.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6f4c48560fa19beb"}},{"code_sha256_prefix":"3078648c75e3e1e3","entry":"softmax_entropy","repo":"Feliciaxyao/ICML2024-FSTTA","repo_kind":"official","path":"map_nav_src/models/FSTTA.py","file_url":"https://github.com/Feliciaxyao/ICML2024-FSTTA/blob/HEAD/map_nav_src/models/FSTTA.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3078648c75e3e1e3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}