Papers › Creating Hierarchical Dispositions of Needs in an Agent

Creating Hierarchical Dispositions of Needs in an Agent

23 Nov 2024arXiv:2412.00044archive 2025-07-28

Tofara Moyo

We present a novel method for learning hierarchical abstractions that prioritize competing objectives, leading to improved global expected rewards. Our approach employs a secondary rewarding agent with multiple scalar outputs, each associated with a distinct level of abstraction. The traditional agent then learns to maximize these outputs in a hierarchical manner, conditioning each level on the maximization of the preceding level. We derive an equation that orders these scalar values and the global reward by priority, inducing a hierarchy of needs that informs goal formation. Experimental results on the Pendulum v1 environment demonstrate superior performance compared to a baseline implementation.We achieved state of the art results.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

OpenAI GymReinforcement Learning

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
OpenAI Gym Pendulum-v1 TLA with Hierarchical Reward Functions Action Repetition .8073 #1 of 2 Archive leaderboard report
OpenAI Gym Pendulum-v1 TLA with Hierarchical Reward Functions Average Decisions 38.6 #1 of 2 Archive leaderboard report
OpenAI Gym Pendulum-v1 TLA with Hierarchical Reward Functions Mean Reward -125.02 #1 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections