Browse State-of-the-Art › Hierarchical Reinforcement Learning
Hierarchical Reinforcement Learning
111 papers with code · 1 benchmark · 2 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Ant + Maze (1 row) | STAR | Reconciling Spatial and Temporal Abstractions for Goal Representation | code | Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 384 · with a code link: 111 · where Syntology ran a sample: 22 (22 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (22 of 384 tagged: 22 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 4: papers 1 to 100 of 384, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
12 Dec 2010 15 repositories listed Syntology 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples)We present a tutorial on Bayesian optimization, a method of finding the maximum of expensive cost functions.
-
21 May 2018 12 repositories listedIn this paper, we study how we can develop HRL algorithms that are general, in that they do not make onerous additional assumptions beyond standard RL algorithms, and efficient, in the sense that they can be used with…
-
2 Oct 2018 6 repositories listedWe study the problem of representation learning in goal-conditioned hierarchical reinforcement learning.
-
21 May 1999 5 repositories listedThe paper presents an online model-free learning algorithm, MAXQ-Q, and proves that it converges wih probability 1 to a kind of locally-optimal policy known as a recursively optimal policy, even in the presence of the…
-
29 Apr 2020 4 repositories listedExisting approaches usually employ a flat policy structure that treat all symptoms and diseases equally for action making.
-
4 Dec 2017 4 repositories listedHierarchical agents have the potential to solve sequential decision making tasks with greater sample efficiency than their non-hierarchical counterparts because hierarchical agents can break down tasks into sets of…
-
10 Feb 2025 3 repositories listedWe train our ReasonFlux-32B model with only 8 GPUs and introduces three innovations: (i) a structured and generic thought template library, containing around 500 high-level thought templates capable of generalizing to…
-
19 Jul 2022 3 repositories listedDue to this one-to-many dilemma, enlarged action space and ignoring logical relationship between entity and relation increase the difficulty of learning.
-
12 Oct 2024 2 repositories listedGoal-conditioned hierarchical reinforcement learning (HRL) decomposes complex reaching tasks into a sequence of simple subgoal-conditioned tasks, showing significant promise for addressing long-horizon planning in…
-
25 Jun 2024 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)Specifically, the whole VNE process is decomposed into an upper-level policy for deciding whether to admit the arriving VNR or not and a lower-level policy for allocating resources of the physical network to meet the…
-
26 Aug 2022 2 repositories listedMotivated by this, we investigate developing a learning-based over-sampling algorithm to optimize the classification performance, which is a challenging task because of the huge and hierarchical decision space.
-
22 Mar 2021 2 repositories listedThis problem is referred to as hierarchical imitation learning and can be handled as an inference problem in a Hidden Markov Model, which is done via an Expectation-Maximization type algorithm.
-
11 Jun 2020 2 repositories listedWe test HDNO on MultiWoz 2.
-
12 Nov 2019 2 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)Furthermore, to approximate solutions to constrained combinatorial optimization problems such as the TSP with time windows, we train hierarchical GPNs (HGPNs) using RL, which learns a hierarchical policy to find an…
-
31 Oct 2019 2 repositories listedFairness is essential for human society, contributing to stability and productivity.
-
22 Nov 2018 2 repositories listedIn hierarchical reinforcement learning a major challenge is determining appropriate low-level policies.
-
9 Nov 2018 2 repositories listedThe whole extraction process is decomposed into a hierarchy of two-level RL policies for relation detection and entity extraction respectively, so that it is more feasible and natural to deal with overlapping relations.
-
10 Apr 2017 2 repositories listedThen a high-level policy is trained on top of these skills, providing a significant improvement of the exploration and allowing to tackle sparse rewards in the downstream tasks.
-
11 Jun 2025 1 repository listedTo that end, we introduce SkillBlender, a novel hierarchical reinforcement learning framework for versatile humanoid loco-manipulation.
-
9 Jun 2025 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)To overcome these challenges, we recast multi-LLM coordination as an incomplete-information game and seek a Bayesian Nash equilibrium (BNE), in which each agent optimally responds to its probabilistic beliefs about the…
-
26 May 2025 1 repository listedWhile showing sophisticated reasoning abilities, large language models (LLMs) still struggle with long-horizon decision-making tasks due to deficient exploration and long-term credit assignment, especially in…
-
7 May 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 7 harvested samples)In collaborative tasks, autonomous agents fall short of humans in their capability to quickly adapt to new and unfamiliar teammates.
-
6 Apr 2025 1 repository listedWe introduce a novel hierarchical reinforcement learning (HRL) framework that performs top-down recursive planning via learned subgoals, successfully applied to the complex combinatorial puzzle game Sokoban.
-
19 Mar 2025 1 repository listedOur empirical evaluation on a suite of procedurally generated continuous control environments demonstrates that our approach outperforms existing hierarchical reinforcement learning methods in terms of sample…
-
27 Feb 2025 1 repository listedWe provide analysis of the design choices of the reward models and policy, and show the efficacy of μCode at utilizing the execution feedback.
-
21 Feb 2025 1 repository listedHierarchical organization is fundamental to biological systems and human societies, yet artificial intelligence systems often rely on monolithic architectures that limit adaptability and scalability.
-
20 Dec 2024 1 repository listedOur approach continually learns and maintains an interpretable state abstraction, and uses it to invent high-level options with abstract symbolic representations.
-
10 Oct 2024 1 repository listedTo address this, we integrate meta-learning into HRL to enhance the agent's ability to learn and adapt hierarchical policies swiftly.
-
20 Sep 2024 1 repository listedIn recent years, robots and autonomous systems have become increasingly integral to our daily lives, offering solutions to complex problems across various domains.
-
24 Aug 2024 1 repository listedLearning path recommendation aims to provide learners with a reasonable order of items to achieve their learning goals.
-
3 Aug 2024 1 repository listed
-
12 Jul 2024 1 repository listed
-
26 Jun 2024 1 repository listed
-
26 Jun 2024 1 repository listed
-
KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning24 Jun 2024 1 repository listed
-
24 Jun 2024 1 repository listed
-
20 Jun 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 1 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
12 Jun 2024 1 repository listed
-
20 Apr 2024 1 repository listed
-
22 Feb 2024 1 repository listed
-
18 Jan 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
3 Nov 2023 1 repository listed
-
27 Oct 2023 1 repository listed
-
29 Sep 2023 1 repository listed
-
24 Sep 2023 1 repository listed
-
22 Sep 2023 1 repository listed
-
22 Jul 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
1 Jun 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
30 May 2023 1 repository listed
-
26 May 2023 1 repository listed
-
19 Apr 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
8 Feb 2023 1 repository listed
-
25 Jan 2023 1 repository listed
-
20 Dec 2022 1 repository listed
-
9 Aug 2022 1 repository listed
-
16 Jun 2022 1 repository listed
-
8 Jun 2022 1 repository listed
-
23 Mar 2022 1 repository listed
-
7 Mar 2022 1 repository listed
-
1 Mar 2022 1 repository listed
-
24 Jan 2022 1 repository listed
-
9 Dec 2021 1 repository listed
-
6 Dec 2021 1 repository listed
-
6 Dec 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
-
26 Oct 2021 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
20 Oct 2021 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
8 Oct 2021 1 repository listed
-
21 Sep 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
20 Sep 2021 1 repository listed
-
17 Jul 2021 1 repository listed
-
8 Jul 2021 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Globally Optimal Hierarchical Reinforcement Learning for Linearly-Solvable Markov Decision Processes29 Jun 2021 1 repository listed
-
31 May 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
1 Mar 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
19 Feb 2021 1 repository listed
-
16 Jan 2021 1 repository listed
-
1 Jan 2021 1 repository listed
-
9 Nov 2020 1 repository listed
-
7 Oct 2020 1 repository listed
-
11 Aug 2020 1 repository listed
-
20 Jun 2020 1 repository listed Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
18 Jun 2020 1 repository listed
-
17 Jun 2020 1 repository listed
-
7 May 2020 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 9 pointer-only (licence)
-
1 May 2020 1 repository listed
-
13 Apr 2020 1 repository listed
-
5 Dec 2019 1 repository listed
-
23 Nov 2019 1 repository listed
-
22 Nov 2019 1 repository listed
-
10 Oct 2019 1 repository listed
-
17 Sep 2019 1 repository listed
-
11 Sep 2019 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
29 Jul 2019 1 repository listed
-
23 May 2019 1 repository listed
-
4 Mar 2019 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
2 Feb 2019 1 repository listed
-
5 Jan 2019 1 repository listed
Syntology lines on 24 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections