{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-versatile-embodied-navigation","title":"Towards Versatile Embodied Navigation","arxiv_id":"2210.16822","date":"2022-10-30","proceeding":null,"authors":["Hanqing Wang","Wei Liang","Luc van Gool","Wenguan Wang"],"abstract":"With the emergence of varied visual navigation tasks (e.g, image-/object-/audio-goal and vision-language navigation) that specify the target in different ways, the community has made appealing advances in training specialized agents capable of handling individual navigation tasks well. Given plenty of embodied navigation tasks and task-specific solutions, we address a more fundamental question: can we learn a single powerful agent that masters not one but multiple navigation tasks concurrently? First, we propose VXN, a large-scale 3D dataset that instantiates four classic navigation tasks in standardized, continuous, and audiovisual-rich environments. Second, we propose Vienna, a versatile embodied navigation agent that simultaneously learns to perform the four navigation tasks with one model. Building upon a full-attentive architecture, Vienna formulates various navigation tasks as a unified, parse-and-query procedure: the target description, augmented with four task embeddings, is comprehensively interpreted into a set of diversified goal vectors, which are refined as the navigation progresses, and used as queries to retrieve supportive context from episodic history for decision making. This enables the reuse of knowledge across navigation tasks with varying input domains/modalities. We empirically demonstrate that, compared with learning each visual navigation task individually, our multitask agent achieves comparable or even better performance with reduced complexity.","url_abs":"https://arxiv.org/abs/2210.16822v1","url_pdf":"https://arxiv.org/pdf/2210.16822v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-versatile-embodied-navigation","repo_url":"https://github.com/hanqingwangai/vxn","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"vision-language-navigation","task_name":"Vision-Language Navigation"},{"task_slug":"visual-navigation","task_name":"Visual Navigation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2210.16822","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.16822"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hanqingwangai/vxn","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":1,"unverified":4},"by_repo_kind":{"official":{"samples":5,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e3de2e386766be00","entry":"static_to_grid","repo":"hanqingwangai/vxn","repo_kind":"official","path":"habitat_extensions/maps.py","file_url":"https://github.com/hanqingwangai/vxn/blob/HEAD/habitat_extensions/maps.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3de2e386766be00"}},{"code_sha256_prefix":"3559a5421dd17ce5","entry":"colorize_topdown_map","repo":"hanqingwangai/vxn","repo_kind":"official","path":"habitat_extensions/maps.py","file_url":"https://github.com/hanqingwangai/vxn/blob/HEAD/habitat_extensions/maps.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3559a5421dd17ce5"}},{"code_sha256_prefix":"35967088b93afc46","entry":"euclidean_distance","repo":"hanqingwangai/vxn","repo_kind":"official","path":"habitat_extensions/measures.py","file_url":"https://github.com/hanqingwangai/vxn/blob/HEAD/habitat_extensions/measures.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"35967088b93afc46"}},{"code_sha256_prefix":"a18cf65f468918d9","entry":"fft_convolve_torch","repo":"hanqingwangai/vxn","repo_kind":"official","path":"habitat_extensions/audionav_sensor.py","file_url":"https://github.com/hanqingwangai/vxn/blob/HEAD/habitat_extensions/audionav_sensor.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a18cf65f468918d9"}},{"code_sha256_prefix":"deea512d3e44113c","entry":"load_metadata","repo":"hanqingwangai/vxn","repo_kind":"official","path":"habitat_extensions/audionav_sensor.py","file_url":"https://github.com/hanqingwangai/vxn/blob/HEAD/habitat_extensions/audionav_sensor.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"deea512d3e44113c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}