Papers › Model-Free Episodic Control with State Aggregation

Model-Free Episodic Control with State Aggregation

21 Aug 2020arXiv:2008.09685archive 2025-07-28

Rafael Pinto

Episodic control provides a highly sample-efficient method for reinforcement learning while enforcing high memory and computational requirements. This work proposes a simple heuristic for reducing these requirements, and an application to Model-Free Episodic Control (MFEC) is presented. Experiments on Atari games show that this heuristic successfully reduces MFEC computational demands while producing no significant loss of performance when conservative choices of hyperparameters are used. Consequently, episodic control becomes a more feasible option when dealing with reinforcement learning tasks.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Atari GamesReinforcement LearningReinforcement Learning (RL)modelreinforcement-learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Atari Games Atari 2600 Frostbite MFEC Best Score 4020 #28 of 53 Archive leaderboard report
Atari Games Atari 2600 Frostbite MFEC Score 2394 #28 of 53 Archive leaderboard report
Atari Games Atari 2600 HERO MFEC Best Score 13190 #38 of 44 Archive leaderboard report
Atari Games Atari 2600 HERO MFEC Score 11732 #38 of 44 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman MFEC Best Score 11301 #10 of 47 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman MFEC Score 8530.4004 #10 of 47 Archive leaderboard report
Atari Games Atari 2600 Q*Bert MFEC Best Score 19750 #33 of 57 Archive leaderboard report
Atari Games Atari 2600 Q*Bert MFEC Score 14135 #33 of 57 Archive leaderboard report
Atari Games Atari 2600 River Raid MFEC Best Score 5080 #38 of 41 Archive leaderboard report
Atari Games Atari 2600 River Raid MFEC Score 3868 #38 of 41 Archive leaderboard report
Atari Games Atari 2600 Space Invaders MFEC Best Score 2490 #37 of 55 Archive leaderboard report
Atari Games Atari 2600 Space Invaders MFEC Score 1990 #37 of 55 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

MFEC

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections