Visual Navigation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

6 leaderboard tables shown for this task, 6 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

19 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 132 papers with code (316 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments
  20 Nov 2017 8 repositories listed
  This is significant because a robot interpreting a natural-language navigation instruction on the basis of what it sees is carrying out a vision and language process that is similar to Visual Question Answering.
• Cognitive Mapping and Planning for Visual Navigation
  13 Feb 2017 6 repositories listed
  The accumulated belief of the world enables the agent to track visited regions of the environment.
• Think Locally, Act Globally: Federated Learning with Local and Global Representations
  6 Jan 2020 4 repositories listed Syntology ran 1 of 6 samples · 5 unverified
  To this end, we propose a new federated learning algorithm that jointly learns compact local representations on each device and a global model across all devices.
• Sim2Real Predictivity: Does Evaluation in Simulation Predict Real-World Performance?
  13 Dec 2019 4 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Second, we investigate the sim2real predictivity of Habitat-Sim for PointGoal navigation.
• POPGym: Benchmarking Partially Observable Reinforcement Learning
  3 Mar 2023 3 repositories listed
  Real world applications of Reinforcement Learning (RL) are often partially observable, thus requiring memory.
• The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation
  5 Mar 2019 3 repositories listed Syntology ran 1 of 11 samples · 10 unverified
  As deep learning continues to make progress for challenging perception tasks, there is increased interest in combining vision, language, and decision-making.
• Visual Representations for Semantic Target Driven Navigation
  15 May 2018 3 repositories listed
  We propose to using high level semantic and contextual features including segmentation and detection masks obtained by off-the-shelf state-of-the-art vision as observations and use deep network to learn the navigation…
• A 64mW DNN-based Visual Navigation Engine for Autonomous Nano-Drones
  4 May 2018 3 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  As part of our general methodology we discuss the software mapping techniques that enable the state-of-the-art deep convolutional neural network presented in [1] to be fully executed on-board within a strict 6 fps…
• Towards Learning a Generalist Model for Embodied Navigation
  4 Dec 2023 2 repositories listed Syntology ran 10 of 15 samples · 5 unverified
  We conduct extensive experiments to evaluate the performance and generalizability of our model.
• NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
  26 May 2023 2 repositories listed Syntology ran 4 of 5 samples · 1 unverified · 2 pointer-only (licence)
  Trained with an unprecedented scale of data, large language models (LLMs) like ChatGPT and GPT-4 exhibit the emergence of significant reasoning abilities from model scaling.
• SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning
  16 Jun 2022 2 repositories listed
  We introduce SoundSpaces 2.
• Towards real-world navigation with deep differentiable planners
  8 Aug 2021 2 repositories listed
  To avoid the potentially hazardous trial-and-error of reinforcement learning, we focus on differentiable planners such as Value Iteration Networks (VIN), which are trained offline from safe expert demonstrations.
• Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigation
  13 Jul 2021 2 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  In the context of visual navigation, the capacity to map a novel environment is necessary for an agent to exploit its observation history in the considered place and efficiently reach known goals.
• End-to-End Egospheric Spatial Memory
  15 Feb 2021 2 repositories listed
  Spatial memory, or the ability to remember and recall specific locations and objects, is central to autonomous agents' ability to carry out tasks in real environments.
• Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learning
  21 Oct 2020 2 repositories listed
  This precludes the use of the learned policy on a real robot.
• Decoupling Exploration and Exploitation for Meta-Reinforcement Learning without Sacrifices
  6 Aug 2020 2 repositories listed
  Learning a new task often requires both exploring to gather task-relevant information and exploiting this information to solve the task.
• Side-Tuning: A Baseline for Network Adaptation via Additive Side Networks
  31 Dec 2019 2 repositories listed
  When training a neural network for a desired task, one may prefer to adapt a pre-trained network rather than starting from randomly initialized weights.
• SoundSpaces: Audio-Visual Navigation in 3D Environments
  24 Dec 2019 2 repositories listed
  Moving around in the world is naturally a multisensory experience, but today's embodied agents are deaf---restricted to solely their visual perception of the environment.
• VUSFA:Variational Universal Successor Features Approximator to Improve Transfer DRL for Target Driven Visual Navigation
  18 Aug 2019 2 repositories listed
  In this paper, we show how novel transfer reinforcement learning techniques can be applied to the complex task of target driven navigation using the photorealistic AI2THOR simulator.
• Vision-and-Dialog Navigation
  10 Jul 2019 2 repositories listed
  To train agents that search an environment for a goal location, we define the Navigation from Dialog History task.
• An Open Source and Open Hardware Deep Learning-powered Visual Navigation Engine for Autonomous Nano-UAVs
  10 May 2019 2 repositories listed
  Nano-size unmanned aerial vehicles (UAVs), with few centimeters of diameter and sub-10 Watts of total power budget, have so far been considered incapable of running sophisticated visual-based autonomous navigation…
• Scaling and Benchmarking Self-Supervised Visual Representation Learning
  3 May 2019 2 repositories listed
  Self-supervised learning aims to learn representations from the data itself without explicit manual supervision.
• Learning Exploration Policies for Navigation
  5 Mar 2019 2 repositories listed
  Numerous past works have tackled the problem of task-driven navigation.
• Self-Monitoring Navigation Agent via Auxiliary Progress Estimation
  10 Jan 2019 2 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments.
• Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning
  3 Dec 2018 2 repositories listed Syntology ran 1 of 4 samples · 3 unverified
  In this paper we study the problem of learning to learn at both training and test time in the context of visual navigation.
• Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
  16 Sep 2016 2 repositories listed
  To address the second issue, we propose AI2-THOR framework, which provides an environment with high-quality 3D scenes and physics engine.
• Visual Planning: Let's Think Only with Images
  16 May 2025 1 repository listed Syntology ran 4 of 5 samples · 1 unverified
  Recent advancements in Large Language Models (LLMs) and their multimodal extensions (MLLMs) have substantially enhanced machine reasoning across diverse tasks.
• Task-Oriented Communications for Visual Navigation with Edge-Aerial Collaboration in Low Altitude Economy
  25 Apr 2025 1 repository listed
  To support the Low Altitude Economy (LAE), it is essential to achieve precise localization of unmanned aerial vehicles (UAVs) in urban areas where global positioning system (GPS) signals are unavailable.
• Prior Does Matter: Visual Navigation via Denoising Diffusion Bridge Models
  14 Apr 2025 1 repository listed
  In visual navigation, previous diffusion-based policies typically generate action sequences by initiating from denoising Gaussian noise.
• NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigation
  14 Apr 2025 1 repository listed
  To address these limitations, we propose a hybrid approach that combines the strengths of learning-based methods and classical approaches for RGB-only visual navigation.

Syntology lines on 10 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.