Papers › Multi-Goal Reinforcement Learning: Challenging Robotics Environments and Request for Research

Multi-Goal Reinforcement Learning: Challenging Robotics Environments and Request for Research

26 Feb 2018arXiv:1802.09464archive 2025-07-28

Matthias Plappert, Marcin Andrychowicz, Alex Ray, Bob McGrew, Bowen Baker, Glenn Powell, Jonas Schneider, Josh Tobin, Maciek Chociej, Peter Welinder, Vikash Kumar, Wojciech Zaremba

The purpose of this technical report is two-fold. First of all, it introduces a suite of challenging continuous control tasks (integrated with OpenAI Gym) based on currently existing robotics hardware. The tasks include pushing, sliding and pick & place with a Fetch robotic arm as well as in-hand object manipulation with a Shadow Dexterous Hand. All tasks have sparse binary rewards and follow a Multi-Goal Reinforcement Learning (RL) framework in which an agent is told what to do using an additional input. The second part of the paper presents a set of concrete research ideas for improving RL algorithms, most of which are related to Multi-Goal RL and Hindsight Experience Replay.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

28 repositories listed; official and paper-mentioned ones first.

09jvilla/CS234_gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
1110589721/openia-gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
Christopheraburns/openai-gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
DartEnv/dart-env mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
EndingCredits/gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
LucasSilve/openAIgym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
Steve--Hunter/gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
YanglanWang/classic_control mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
YijiongLin/ITER_KER_GER mentioned on GitHubtfSyntology: not harvested report
a-ozeki/openAI_gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
abhiksingla/gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
davidsonic/self_brewed_gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
developer-smartwebzone/-reinforcement-learning-algorithms. mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
flowersteam/curious mentioned on GitHubSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Hindsight Experience Replay (arXiv:1707.01495; that paper's own run record: 16 ran (of which 10 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
gtrll/dartenv mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
jturner65/Getup-DartEnv mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
ligy2016/gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
mbrucker07/experiments mentioned on GitHubSyntology: not harvested report
nmsquared/CS7641-Assignment-4 mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
nohboogy/gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
ozcell/gym_wmgds_ma mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to OpenAI Gym (arXiv:1606.01540; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
shinian123/gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
shriram2112/Reinforcement_learning_gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
tjcdev/mlpgym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
tsinghua-rll/gym-gridworld mentioned on GitHubSyntology: not harvested report
varuncs2011/rl mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
vvanirudh/imitation-learning-gym mentioned on GitHubtfNOASSERTIONSyntology: not harvested report
zubair-irshad/imitation_learning mentioned on GitHubtfSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Continuous ControlMulti-Goal Reinforcement LearningOpenAI GymReinforcement LearningReinforcement Learning (RL)continuous-controlreinforcement-learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Reinforcement Learning (RL) . . 0..5sec . #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Experience Replay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections