Browse State-of-the-Art › Vision-Language Navigation
Vision-Language Navigation
38 papers with code · 1 benchmark · 9 datasets archive 2025-07-28
Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments.
( Image credit: Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Room2Room (3 rows) | R2R+EnvDrop | Learning to Navigate Unseen Environments: Back Translation with... | code | Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
9 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 81 · with a code link: 38 · where Syntology ran a sample: 15 (11 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (15 of 81 tagged: 11 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 81 of 81, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
5 Mar 2019 3 repositories listed Syntology official (archive's flag): 1 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)As deep learning continues to make progress for challenging perception tasks, there is increased interest in combining vision, language, and decision-making.
-
24 Oct 2019 2 repositories listedCommanding a robot to navigate with natural language instructions is a long-term goal for grounded language understanding and robotics.
-
10 Jan 2019 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments.
-
20 Jun 2025 1 repository listedVision-Language Navigation (VLN) is a core challenge in embodied AI, requiring agents to navigate real-world environments using natural language instructions.
-
23 Mar 2025 1 repository listedExperiments on both the discrete environments (R2R, REVERIE, and R4R datasets) and continuous environments (R2R-CE dataset) show the superior performance and impressive generalization ability of our method.
-
9 Dec 2024 1 repository listedSUSA includes a Textual Semantic Understanding (TSU) module, which narrows the modality gap between instructions and environments by generating and associating the descriptions of environmental landmarks in agent's…
-
8 Dec 2024 1 repository listedHuman-interactive robotic systems, particularly autonomous vehicles (AVs), must effectively integrate human instructions into their motion planning.
-
DISCO: Embodied Navigation and Interaction via Differentiable Scene Semantics and Dual-level Control20 Jul 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Building a general-purpose intelligent home-assistant agent skilled in diverse tasks by human commands is a long-term blueprint of embodied AI research, which poses requirements on task planning, environment modeling…
-
29 May 2024 1 repository listedTo mitigate the noise in the priors due to the lack of visual constraints, we introduce a learnable cooccurrence scoring module, which corrects the importance of each cooccurrence according to actual observations for…
-
27 Apr 2024 1 repository listedHumans excel at forming mental maps of their surroundings, equipping them to understand object relationships and navigate based on language queries.
-
2 Apr 2024 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 12 pointer-only (licence)Vision-and-language navigation (VLN) enables the agent to navigate to a remote location following the natural language instruction in 3D environments.
-
21 Mar 2024 1 repository listedTo achieve a comprehensive 3D representation with fine-grained details, we introduce a Volumetric Environment Representation (VER), which voxelizes the physical world into structured 3D cells.
-
2 Dec 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 11 pointer-only (licence)In this paper, we aim to tackle this problem with a unified framework consisting of an end-to-end trainable method and a planning algorithm.
-
18 Nov 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 9 pointer-only (licence)However, several significant challenges remain: (i) most of these models rely on 2D images yet exhibit a limited capacity for 3D input; (ii) these models rarely explore the tasks inherently defined in 3D world, e. g.…
-
9 Aug 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 14 harvested samples) · 14 pointer-only (licence)Vision-language navigation (VLN), which entails an agent to navigate 3D environments following human instructions, has shown great advances.
-
6 Apr 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)To develop a robust VLN-CE agent, we propose a new navigation framework, ETPNav, which focuses on two critical skills: 1) the capability to abstract environments and generate long-range navigation plans, and 2) the…
-
1 Jan 2023 1 repository listedIn this paper, we propose an Adaptive Zone-aware Hierarchical Planner (AZHP) to explicitly divides the navigation process into two heterogeneous phases, i. e., sub-goal setting via zone partition/selection (high-level…
-
30 Oct 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)With the emergence of varied visual navigation tasks (e. g, image-/object-/audio-goal and vision-language navigation) that specify the target in different ways, the community has made appealing advances in training…
-
22 Oct 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)These reactive agents are insufficient for long-horizon complex tasks.
-
19 Jul 2022 1 repository listedVision-language navigation is the task of directing an embodied agent to navigate in 3D scenes with natural language instructions.
-
CLEAR: Improving Vision-Language Navigation with Cross-Lingual, Environment-Agnostic Representations5 Jul 2022 1 repository listedEmpirically, on the Room-Across-Room dataset, we show that our multilingual agent gets large improvements in all metrics over the strong baseline model when generalizing to unseen environments with the cross-lingual…
-
20 Apr 2022 1 repository listedHowever, the crucial navigation clues (i. e., object-level environment layout) for embodied navigation task is discarded since the maintained vector is essentially unstructured.
-
30 Mar 2022 1 repository listedSince the rise of vision-language navigation (VLN), great progress has been made in instruction following -- building a follower to navigate environments under the guidance of instructions.
-
8 Mar 2022 1 repository listedTo improve the ability of fast cross-domain adaptation, we propose Prompt-based Environmental Self-exploration (ProbES), which can self-explore the environments by sampling trajectories and automatically generates…
-
4 Feb 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)To study VLN with unknown command feasibility, we introduce a new dataset Mobile app Tasks with Iterative Feedback (MoTIF), where the goal is to complete a natural language command in a mobile app.
-
8 Dec 2021 1 repository listedThe vision-language navigation (VLN) task requires an agent to reach a target with the guidance of natural language instruction.
-
23 Jul 2021 1 repository listedSpecifically, we propose a Dynamic Reinforced Instruction Attacker (DR-Attacker), which learns to mislead the navigator to move to the wrong target by destroying the most instructive information in instructions at…
-
15 Jun 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)Then, we cross-connect the key views of different scenes to construct augmented scenes.
-
19 Apr 2021 1 repository listedOne key challenge in this task is to ground instructions with the current visual information that the agent perceives.
-
9 Apr 2021 1 repository listedVision-and-Language Navigation (VLN) requires an agent to find a path to a remote location on the basis of natural-language instructions and a set of photo-realistic panoramas.
-
5 Mar 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
19 Jan 2021 1 repository listed
-
15 Jul 2020 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
1 Mar 2020 1 repository listed
-
8 Apr 2019 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
6 Mar 2019 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
5 Mar 2019 1 repository listed
-
21 Mar 2018 1 repository listed
-
SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Models17 Jul 2025 0 repositories listed
-
Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understanding12 Jun 2025 0 repositories listed
-
Generating Vision-Language Navigation Instructions Incorporated Fine-Grained Alignment Annotations10 Jun 2025 0 repositories listed
-
Active Test-time Vision-Language Navigation7 Jun 2025 0 repositories listed
-
EvolveNav: Self-Improving Embodied Reasoning for LLM-Based Vision-Language Navigation2 Jun 2025 0 repositories listed
-
Automated Data Curation Using GPS & NLP to Generate Instruction-Action Pairs for Autonomous Vehicle Vision-Language Navigation Datasets6 May 2025 0 repositories listed
-
UAV-VLN: End-to-End Vision Language guided Navigation for UAVs30 Apr 2025 0 repositories listed
-
ReasonGrounder: LVLM-Guided Hierarchical Feature Splatting for Open-Vocabulary 3D Visual Grounding and Reasoning30 Mar 2025 0 repositories listed
-
OpenFly: A Comprehensive Platform for Aerial Vision-Language Navigation25 Feb 2025 0 repositories listed
-
TRAVEL: Training-Free Retrieval and Alignment for Vision-and-Language Navigation11 Feb 2025 0 repositories listed
-
VL-Nav: Real-time Vision-Language Navigation with Spatial Reasoning2 Feb 2025 0 repositories listed
-
NAVCON: A Cognitively Inspired and Linguistically Grounded Corpus for Vision and Language Navigation17 Dec 2024 0 repositories listed
-
Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments13 Dec 2024 0 repositories listed
-
Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Method12 Dec 2024 0 repositories listed
-
UnitedVLN: Generalizable Gaussian Splatting for Continuous Vision-Language Navigation25 Nov 2024 0 repositories listed
-
Zero-shot Object-Centric Instruction Following: Integrating Foundation Models with Traditional Navigation12 Nov 2024 0 repositories listed
-
Vision-Language Navigation with Energy-Based Policy18 Oct 2024 0 repositories listed
-
Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodology9 Oct 2024 0 repositories listed
-
Navigating the Nuances: A Fine-grained Evaluation of Vision-Language Navigation25 Sep 2024 0 repositories listed
-
ASMA: An Adaptive Safety Margin Algorithm for Vision-Language Drone Navigation via Scene-Aware Control Barrier Functions16 Sep 2024 0 repositories listed
-
Seeing is Believing? Enhancing Vision-Language Navigation using Visual Perturbations9 Sep 2024 0 repositories listed
-
Cog-GA: A Large Language Models-based Generative Agent for Vision-Language Navigation in Continuous Environments4 Sep 2024 0 repositories listed
-
Vision-Language Navigation with Continual Learning4 Sep 2024 0 repositories listed
-
Malicious Path Manipulations via Exploitation of Representation Vulnerabilities of Vision-Language Navigation Systems10 Jul 2024 0 repositories listed
-
Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigation8 Jul 2024 0 repositories listed
-
TINA: Think, Interaction, and Action Framework for Zero-Shot Vision Language Navigation13 Mar 2024 0 repositories listed
-
Vision-Language Navigation with Embodied Intelligence: A Survey22 Feb 2024 0 repositories listed
-
What Is Near?: Room Locality Learning for Enhanced Robot Vision-Language-Navigation in Indoor Living Environments10 Sep 2023 0 repositories listed
-
DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation14 Aug 2023 0 repositories listed
-
Active Semantic Localization with Graph Neural Embedding10 May 2023 0 repositories listed
-
Accessible Instruction-Following Agent8 May 2023 0 repositories listed
-
Actional Atomic-Concept Learning for Demystifying Vision-Language Navigation13 Feb 2023 0 repositories listed
-
A survey on knowledge-enhanced multimodal learning19 Nov 2022 0 repositories listed
-
Anticipating the Unseen Discrepancy for Vision and Language Navigation10 Sep 2022 0 repositories listed
-
ADAPT: Vision-Language Navigation with Modality-Aligned Action Prompts31 May 2022 0 repositories listed
-
On the Importance of Karaka Framework in Multi-modal Grounding9 Apr 2022 0 repositories listed
-
Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration16 Nov 2021 0 repositories listed
-
Vision-Language Navigation: A Survey and Taxonomy26 Aug 2021 0 repositories listed
-
Modular Graph Attention Network for Complex Visual Relational Reasoning22 Nov 2020 0 repositories listed
-
28 Sep 2020 0 repositories listed
-
18 Nov 2019 0 repositories listed
-
Generalized Natural Language Grounded Navigation via Environment-agnostic Multitask Learning25 Sep 2019 0 repositories listed
-
25 Nov 2018 0 repositories listed
Syntology lines on 16 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections