Papers › Train a Real-world Local Path Planner in One Hour via Partially Decoupled...

Train a Real-world Local Path Planner in One Hour via Partially Decoupled Reinforcement Learning and Vectorized Diversity

7 May 2023arXiv:2305.04180archive 2025-07-28

Jinghao Xin, Jinwoo Kim, Zhi Li, Ning li

Deep Reinforcement Learning (DRL) has exhibited efficacy in resolving the Local Path Planning (LPP) problem. However, such application in the real world is immensely limited due to the deficient training efficiency and generalization capability of DRL. To alleviate these two issues, a solution named Color is proposed, which consists of an Actor-Sharer-Learner (ASL) training framework and a mobile robot-oriented simulator Sparrow. Specifically, the ASL intends to improve the training efficiency of DRL algorithms. It employs a Vectorized Data Collection (VDC) mode to expedite data acquisition, decouples the data collection from model optimization by multithreading, and partially connects the two procedures by harnessing a Time Feedback Mechanism (TFM) to evade data underuse or overuse. Meanwhile, the Sparrow simulator utilizes a 2D grid-based world, simplified kinematics, and conversion-free data flow to achieve a lightweight design. The lightness facilitates vectorized diversity, allowing diversified simulation setups across extensive copies of the vectorized environments, resulting in a notable enhancement in the generalization capability of the DRL algorithm being trained. Comprehensive experiments, comprising 57 DRL benchmark environments, 32 simulated and 36 real-world LPP scenarios, have been conducted to corroborate the superiority of our method in terms of efficiency and generalization. The code and the video of this paper are accessible at https://github.com/XinJingHao/Color.

PaperPDFCode

Code

xinjinghao/color officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Atari GamesDeep Reinforcement LearningDiversityRobot Navigation

Datasets

Introduced by this paper, per the archive.

Sparrow

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Atari Games Atari 2600 Alien ASL DDQN Score 6955.2 #14 of 49 Archive leaderboard report
Atari Games Atari 2600 Amidar ASL DDQN Score 2232.3 #11 of 48 Archive leaderboard report
Atari Games Atari 2600 Assault ASL DDQN Score 14372.8 #14 of 45 Archive leaderboard report
Atari Games Atari 2600 Asterix ASL DDQN Score 567640 #8 of 49 Archive leaderboard report
Atari Games Atari 2600 Asteroids ASL DDQN Score 1984.5 #27 of 43 Archive leaderboard report
Atari Games Atari 2600 Atlantis ASL DDQN Score 947275 #16 of 42 Archive leaderboard report
Atari Games Atari 2600 Bank Heist ASL DDQN Score 1340.9 #10 of 45 Archive leaderboard report
Atari Games Atari 2600 Battle Zone ASL DDQN Score 38986 #16 of 47 Archive leaderboard report
Atari Games Atari 2600 Beam Rider ASL DDQN Score 26841.6 #15 of 49 Archive leaderboard report
Atari Games Atari 2600 Berzerk ASL DDQN Score 2597.2 #14 of 39 Archive leaderboard report
Atari Games Atari 2600 Bowling ASL DDQN Score 62.4 #23 of 44 Archive leaderboard report
Atari Games Atari 2600 Boxing ASL DDQN Score 99.6 #15 of 45 Archive leaderboard report
Atari Games Atari 2600 Breakout ASL DDQN Score 621.7 #18 of 58 Archive leaderboard report
Atari Games Atari 2600 Centipede ASL DDQN Score 3899.8 #38 of 45 Archive leaderboard report
Atari Games Atari 2600 Chopper Command ASL DDQN Score 15071 #15 of 45 Archive leaderboard report
Atari Games Atari 2600 Crazy Climber ASL DDQN Score 166019 #13 of 49 Archive leaderboard report
Atari Games Atari 2600 Defender ASL DDQN Score 37026.5 #18 of 21 Archive leaderboard report
Atari Games Atari 2600 Demon Attack ASL DDQN Score 119773.9 #14 of 46 Archive leaderboard report
Atari Games Atari 2600 Double Dunk ASL DDQN Score 0.1 #25 of 43 Archive leaderboard report
Atari Games Atari 2600 Enduro ASL DDQN Score 2103.1 #16 of 48 Archive leaderboard report
Atari Games Atari 2600 Fishing Derby ASL DDQN Score 35.1 #21 of 44 Archive leaderboard report
Atari Games Atari 2600 Freeway ASL DDQN Score 33.9 #12 of 59 Archive leaderboard report
Atari Games Atari 2600 Frostbite ASL DDQN Score 8616.4 #12 of 53 Archive leaderboard report
Atari Games Atari 2600 Gopher ASL DDQN Score 103514.4 #12 of 43 Archive leaderboard report
Atari Games Atari 2600 Gravitar ASL DDQN Score 760 #26 of 53 Archive leaderboard report
Atari Games Atari 2600 HERO ASL DDQN Score 26578.5 #18 of 44 Archive leaderboard report
Atari Games Atari 2600 Ice Hockey ASL DDQN Score -3.6 #43 of 43 Archive leaderboard report
Atari Games Atari 2600 James Bond ASL DDQN Score 2237 #17 of 45 Archive leaderboard report
Atari Games Atari 2600 Kangaroo ASL DDQN Score 13027 #17 of 47 Archive leaderboard report
Atari Games Atari 2600 Krull ASL DDQN Score 10422.5 #17 of 45 Archive leaderboard report
Atari Games Atari 2600 Kung-Fu Master ASL DDQN Score 85182 #11 of 43 Archive leaderboard report
Atari Games Atari 2600 Montezuma's Revenge ASL DDQN Score 0 #49 of 50 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman ASL DDQN Score 4416 #21 of 47 Archive leaderboard report
Atari Games Atari 2600 Name This Game ASL DDQN Score 16535.4 #13 of 43 Archive leaderboard report
Atari Games Atari 2600 Phoenix ASL DDQN Score 71752.6 #12 of 21 Archive leaderboard report
Atari Games Atari 2600 Pitfall! ASL DDQN Score 0 #19 of 23 Archive leaderboard report
Atari Games Atari 2600 Pong ASL DDQN Score 21 #14 of 52 Archive leaderboard report
Atari Games Atari 2600 Private Eye ASL DDQN Score 349.7 #28 of 52 Archive leaderboard report
Atari Games Atari 2600 Q*Bert ASL DDQN Score 24548.8 #17 of 57 Archive leaderboard report
Atari Games Atari 2600 River Raid ASL DDQN Score 24445 #9 of 41 Archive leaderboard report
Atari Games Atari 2600 Road Runner ASL DDQN Score 56520 #21 of 44 Archive leaderboard report
Atari Games Atari 2600 Robotank ASL DDQN Score 65.8 #13 of 42 Archive leaderboard report
Atari Games Atari 2600 Seaquest ASL DDQN Score 29278.6 #14 of 57 Archive leaderboard report
Atari Games Atari 2600 Skiing ASL DDQN Score -8295.4 #23 of 23 Archive leaderboard report
Atari Games Atari 2600 Solaris ASL DDQN Score 3506.8 #16 of 23 Archive leaderboard report
Atari Games Atari 2600 Space Invaders ASL DDQN Score 21602 #13 of 55 Archive leaderboard report
Atari Games Atari 2600 Star Gunner ASL DDQN Score 129140 #13 of 43 Archive leaderboard report
Atari Games Atari 2600 Surround ASL DDQN Score 2.5 #12 of 15 Archive leaderboard report
Atari Games Atari 2600 Tennis ASL DDQN Score 22.3 #9 of 43 Archive leaderboard report
Atari Games Atari 2600 Time Pilot ASL DDQN Score 12071 #19 of 44 Archive leaderboard report
Atari Games Atari 2600 Tutankham ASL DDQN Score 252.9 #16 of 44 Archive leaderboard report
Atari Games Atari 2600 Up and Down ASL DDQN Score 25127.4 #26 of 44 Archive leaderboard report
Atari Games Atari 2600 Venture ASL DDQN Score 291 #26 of 55 Archive leaderboard report
Atari Games Atari 2600 Video Pinball ASL DDQN Score 626794 #12 of 42 Archive leaderboard report
Atari Games Atari 2600 Wizard of Wor ASL DDQN Score 21049 #12 of 41 Archive leaderboard report
Atari Games Atari 2600 Yars Revenge ASL DDQN Score 29231.9 #13 of 17 Archive leaderboard report
Atari Games Atari 2600 Zaxxon ASL DDQN Score 16420 #15 of 41 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Double DQNDouble Q-learningExperience Replay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections