{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adaptive-and-explainable-deployment-of","title":"Adaptive and Explainable Deployment of Navigation Skills via Hierarchical Deep Reinforcement Learning","arxiv_id":"2305.19746","date":"2023-05-31","proceeding":null,"authors":["Kyowoon Lee","Seongun Kim","Jaesik Choi"],"abstract":"For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a hand-engineered curriculum and reward function which are difficult to be deployed in a wide range of real-world scenarios. In this paper, we propose a framework to learn a family of low-level navigation policies and a high-level policy for deploying them. The main idea is that, instead of learning a single navigation policy with a fixed reward function, we simultaneously learn a family of policies that exhibit different behaviors with a wide range of reward functions. We then train the high-level policy which adaptively deploys the most suitable navigation skill. We evaluate our approach in simulation and the real world and demonstrate that our method can learn diverse navigation skills and adaptively deploy them. We also illustrate that our proposed hierarchical learning framework presents explainability by providing semantics for the behavior of an autonomous agent.","url_abs":"https://arxiv.org/abs/2305.19746v2","url_pdf":"https://arxiv.org/pdf/2305.19746v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"adaptive-and-explainable-deployment-of","repo_url":"https://github.com/leekwoon/hrl-nav","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"adaptive-and-explainable-deployment-of","repo_url":"https://github.com/leekwoon/nav-gym","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2305.19746","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.19746"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/leekwoon/nav-gym","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/leekwoon/hrl-nav","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"ran_honours":1,"unverified":19},"by_repo_kind":{"official":{"samples":13,"ran":5,"repositories":1},"listed":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"93d28ca67303e04b","entry":"clip_magnitude","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/rlkit/pythonplusplus.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/rlkit/pythonplusplus.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"93d28ca67303e04b"}},{"code_sha256_prefix":"fadf5f762ff04cd6","entry":"create_stats_ordered_dict","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/rlkit/core/eval_util.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/rlkit/core/eval_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fadf5f762ff04cd6"}},{"code_sha256_prefix":"a5d10a0b704c8db7","entry":"get_average_returns","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/rlkit/core/eval_util.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/rlkit/core/eval_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5d10a0b704c8db7"}},{"code_sha256_prefix":"9910e2fc297f8665","entry":"identity","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/rlkit/pythonplusplus.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/rlkit/pythonplusplus.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9910e2fc297f8665"}},{"code_sha256_prefix":"4138766e854db009","entry":"is_numeric","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/rlkit/pythonplusplus.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/rlkit/pythonplusplus.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4138766e854db009"}},{"code_sha256_prefix":"6dc14f1205c31904","entry":"add_prefix","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/rlkit/core/logging.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/rlkit/core/logging.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6dc14f1205c31904"}},{"code_sha256_prefix":"2d7021ec04e923a7","entry":"angle_correction","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/utils.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2d7021ec04e923a7"}},{"code_sha256_prefix":"46e6d80fdfab6884","entry":"append_log","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/rlkit/core/logging.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/rlkit/core/logging.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"46e6d80fdfab6884"}},{"code_sha256_prefix":"93c4164bfdeaa79b","entry":"batch_ij_to_xy","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/env.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/env.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"93c4164bfdeaa79b"}},{"code_sha256_prefix":"4d0ee41393f69bdb","entry":"batch_xy_to_ij","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/env.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/env.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4d0ee41393f69bdb"}},{"code_sha256_prefix":"9a021afdebbda6ba","entry":"find_nearest_node","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/map_generator.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/map_generator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9a021afdebbda6ba"}},{"code_sha256_prefix":"f42374c639e39b5c","entry":"get_constellation","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/map_generator.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/map_generator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f42374c639e39b5c"}},{"code_sha256_prefix":"586e2809ff076392","entry":"high_level_preprocess_obs","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/hrl_nav/hierarchical_networks.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/hrl_nav/hierarchical_networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"586e2809ff076392"}},{"code_sha256_prefix":"e04f26b9a69ea8ff","entry":"ij_to_xy","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/env.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/env.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e04f26b9a69ea8ff"}},{"code_sha256_prefix":"3b1d78694ddad6a5","entry":"initialize_map","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/map_generator.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/map_generator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b1d78694ddad6a5"}},{"code_sha256_prefix":"20fd2dcdde887f8c","entry":"log_normal_density","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/human_policy.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/human_policy.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"20fd2dcdde887f8c"}},{"code_sha256_prefix":"99122a07e5199735","entry":"low_level_preprocess_obs","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/hrl_nav/hierarchical_networks.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/hrl_nav/hierarchical_networks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"99122a07e5199735"}},{"code_sha256_prefix":"0e1d6e1622e25bb1","entry":"make_circle","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/ros_env.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/ros_env.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0e1d6e1622e25bb1"}},{"code_sha256_prefix":"e737aeb7a52e2474","entry":"observation_batch_to_dict","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/hrl_nav/hierarchical_env.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/hrl_nav/hierarchical_env.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e737aeb7a52e2474"}},{"code_sha256_prefix":"81f8eb8bc3ef1ba5","entry":"observation_batch_to_dict","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/hrl_nav/reward_randomize_env.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/hrl_nav/reward_randomize_env.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"81f8eb8bc3ef1ba5"}},{"code_sha256_prefix":"87c99beae45d5faa","entry":"observation_to_dict","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/hrl_nav/hierarchical_env.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/hrl_nav/hierarchical_env.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87c99beae45d5faa"}},{"code_sha256_prefix":"d0e19d69ff080b1b","entry":"observation_to_dict","repo":"leekwoon/hrl-nav","repo_kind":"official","path":"src/hrl_nav/reward_randomize_env.py","file_url":"https://github.com/leekwoon/hrl-nav/blob/HEAD/src/hrl_nav/reward_randomize_env.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d0e19d69ff080b1b"}},{"code_sha256_prefix":"21bc8fb230340176","entry":"quaternion_matrix_from_yaw","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/utils.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"21bc8fb230340176"}},{"code_sha256_prefix":"78f49afa263a292a","entry":"translation_matrix_from_xyz","repo":"leekwoon/nav-gym","repo_kind":"listed","path":"nav_gym/src/nav_gym_env/utils.py","file_url":"https://github.com/leekwoon/nav-gym/blob/HEAD/nav_gym/src/nav_gym_env/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"78f49afa263a292a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}