Papers › Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation

Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation

17 Dec 2022arXiv:2212.08801archive 2025-07-28

Yimeng Li, Arnab Debnath, Gregory J. Stein, Jana Kosecka

In recent years several learning approaches to point goal navigation in previously unseen environments have been proposed. They vary in the representations of the environments, problem decomposition, and experimental evaluation. In this work, we compare the state-of-the-art Deep Reinforcement Learning based approaches with Partially Observable Markov Decision Process (POMDP) formulation of the point goal navigation problem. We adapt the (POMDP) sub-goal framework proposed by [1] and modify the component that estimates frontier properties by using partial semantic maps of indoor scenes built from images' semantic segmentation. In addition to the well-known completeness of the model-based approach, we demonstrate that it is robust and efficient in that it leverages informative, learned properties of the frontiers compared to an optimistic frontier-based planner. We also demonstrate its data efficiency compared to the end-to-end deep reinforcement learning approaches. We compare our results against an optimistic planner, ANS and DD-PPO on Matterport3D dataset using the Habitat Simulator. We show comparable, though slightly worse performance than the SOTA DD-PPO approach, yet with far fewer data.

PaperPDFCode

Code

yimengli46/bellman_point_goal officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Deep Reinforcement LearningPointGoal NavigationProblem DecompositionReinforcement LearningReinforcement Learning (RL)Semantic Segmentationmodelreinforcement-learning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

DD-PPO

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections