Methods › Reinforcement Learning › Replay Memory › Experience Replay
Experience Replay
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, eₜ = (sₜ, aₜ, rₜ, sₜ₊₁) in a data-set D = e₁, ⋯, e_N , pooled over many episodes into a replay memory. We then usually sample the memory randomly for a minibatch of experience, and use this to learn off-policy, as with Deep Q-Networks. This tackles the problem of autocorrelation leading to unstable training, by making the problem more like a supervised learning problem.
Image Credit: Hands-On Reinforcement Learning with Python, Sudharsan Ravichandiran
In Syntology no code under this name (no_code; paper_only). The lookup matched 'experience replay' ignoring case. The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2108.12081) is about this method is not checked; it does not say whether this method has code.
Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.
- Curious Replay · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Curious Replay') - Dark Experience Replay · shares_name_tokens (shares name tokens with this name; a different method) · level V3 · retrieve with
get_reference_implementation(name='Dark Experience Replay') - a simple approach that learns a reward model from online experience · shares_name_tokens (shares name tokens with this name; a different method) · level V2 · retrieve with
get_reference_implementation(name='a simple approach that learns a reward model from online experience')
Origin paper of this answer, arXiv:2108.12081 (its page on Syntology).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
What each level means, quoted from Syntology's server card: V0 “imports”; V1 “executes against a synthesized fixture and returns a value of the recorded type”; V2 “two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs” “neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)”; V3 “paper-derived property tests pass on both of those same two generations.” The card adds: “No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results.” A level quoted in two parts is one definition the card writes as two clauses joined by a double hyphen, each clause quoted on its own (how these levels are quoted).
Papers archive 2025-07-28
archive papers tagged: 865 · with a code link: 317 · where Syntology ran a sample: 94 (83 with a run with no instrument failure, 11 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (94 of 865 tagged: 83 with a run with no instrument failure, 11 where every run was a failure of Syntology's instrument)
Page 1 of 9: papers 1 to 100 of 865, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Turning Sand to Gold: Recycling Data to Bridge On-Policy and Off-Policy Learning via Causal Bound 15 Jul 2025 · 0 repositories · arXiv:2507.11269
-
Deep Reinforcement Learning with Gradient Eligibility Traces 12 Jul 2025 · 1 repository · arXiv:2507.09087
-
Multi-Objective Reinforcement Learning for Cognitive Radar Resource Management 25 Jun 2025 · 0 repositories · arXiv:2506.20853
-
CAWR: Corruption-Averse Advantage-Weighted Regression for Robust Policy Optimization 18 Jun 2025 · 1 repository · arXiv:2506.15654
-
Reliable Critics: Monotonic Improvement and Convergence Guarantees for Reinforcement Learning 8 Jun 2025 · 0 repositories · arXiv:2506.07134
-
Contextual Experience Replay for Self-Improvement of Language Agents 7 Jun 2025 · 0 repositories · arXiv:2506.06698
-
Gradual Transition from Bellman Optimality Operator to Bellman Operator in Online Reinforcement Learning 6 Jun 2025 · 1 repository · arXiv:2506.05968Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
-
A Novel Deep Reinforcement Learning Method for Computation Offloading in Multi-User Mobile Edge Computing with Decentralization 3 Jun 2025 · 0 repositories · arXiv:2506.02458
-
FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control 28 May 2025 · 0 repositories · arXiv:2505.22642
-
Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models 23 May 2025 · 0 repositories · arXiv:2505.17496
-
LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models 21 May 2025 · 0 repositories · arXiv:2505.15293
-
LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners 17 May 2025 · 1 repository · arXiv:2505.11942
-
Unveiling the Black Box: A Multi-Layer Framework for Explaining Reinforcement Learning-Based Cyber Agents 16 May 2025 · 0 repositories · arXiv:2505.11708
-
Electric Bus Charging Schedules Relying on Real Data-Driven Targets Based on Hierarchical Deep Reinforcement Learning 15 May 2025 · 0 repositories · arXiv:2505.10262
-
Deep reinforcement learning-based longitudinal control strategy for automated vehicles at signalised intersections 13 May 2025 · 0 repositories · arXiv:2505.08896
-
GradMix: Gradient-based Selective Mixup for Robust Data Augmentation in Class-Incremental Learning 13 May 2025 · 0 repositories · arXiv:2505.08528
-
Monte Carlo Beam Search for Actor-Critic Reinforcement Learning in Continuous Control 13 May 2025 · 0 repositories · arXiv:2505.09029
-
Online Learning-based Adaptive Beam Switching for 6G Networks: Enhancing Efficiency and Resilience 12 May 2025 · 1 repository · arXiv:2505.08032
-
Energy Efficient RSMA-Based LEO Satellite Communications Assisted by UAV-Mounted BD-Active RIS: A DRL Approach 7 May 2025 · 0 repositories · arXiv:2505.04148
-
A Goal-Oriented Reinforcement Learning-Based Path Planning Algorithm for Modular Self-Reconfigurable Satellites 4 May 2025 · 0 repositories · arXiv:2505.01966
-
Approximation to Deep Q-Network by Stochastic Delay Differential Equations 1 May 2025 · 0 repositories · arXiv:2505.00382
-
AlphaGrad: Non-Linear Gradient Normalization Optimizer 22 Apr 2025 · 0 repositories · arXiv:2504.16020
-
Next-Future: Sample-Efficient Policy Learning for Robotic-Arm Tasks 15 Apr 2025 · 0 repositories · arXiv:2504.11247
-
Moderate Actor-Critic Methods: Controlling Overestimation Bias via Expectile Loss 14 Apr 2025 · 0 repositories · arXiv:2504.09929
-
Graph Based Deep Reinforcement Learning Aided by Transformers for Multi-Agent Cooperation 11 Apr 2025 · 0 repositories · arXiv:2504.08195
-
Proxy-Anchor and EVT-Driven Continual Learning Method for Generalized Category Discovery 11 Apr 2025 · 1 repository · arXiv:2504.08550
-
Neuron-level Balance between Stability and Plasticity in Deep Reinforcement Learning 9 Apr 2025 · 0 repositories · arXiv:2504.08000
-
Think Small, Act Big: Primitive Prompt Learning for Lifelong Robot Manipulation 1 Apr 2025 · 0 repositories · arXiv:2504.00420
-
Dynamic Operating System Scheduling Using Double DQN: A Reinforcement Learning Approach to Task Optimization 31 Mar 2025 · 0 repositories · arXiv:2503.23659
-
Pareto Continual Learning: Preference-Conditioned Learning and Adaption for Dynamic Stability-Plasticity Trade-off 30 Mar 2025 · 1 repository · arXiv:2503.23390
-
World Model Agents with Change-Based Intrinsic Motivation 26 Mar 2025 · 1 repository · arXiv:2503.21047
-
Experience Replay Addresses Loss of Plasticity in Continual Learning 25 Mar 2025 · 0 repositories · arXiv:2503.20018
-
Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training 24 Mar 2025 · 1 repository · arXiv:2503.18929Syntology 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
H2-MARL: Multi-Agent Reinforcement Learning for Pareto Optimality in Hospital Capacity Strain and Human Mobility during Epidemic 13 Mar 2025 · 0 repositories · arXiv:2503.10907
-
Intelligent Joint Security and Delay Determinacy Performance Guarantee Strategy in RIS-Assisted IIoT Communication Systems 11 Mar 2025 · 0 repositories · arXiv:2503.08086
-
PER-DPP Sampling Framework and Its Application in Path Planning 10 Mar 2025 · 0 repositories · arXiv:2503.07411
-
Fully-Decentralized MADDPG with Networked Agents 9 Mar 2025 · 0 repositories · arXiv:2503.06747
-
Closing the Intent-to-Behavior Gap via Fulfillment Priority Logic 4 Mar 2025 · 0 repositories · arXiv:2503.05818
-
IL-SOAR : Imitation Learning with Soft Optimistic Actor cRitic 27 Feb 2025 · 0 repositories · arXiv:2502.19859
-
PVBF: A Framework for Mitigating Parameter Variation Imbalance in Online Continual Learning 25 Feb 2025 · 0 repositories · arXiv:2502.17794
-
SECURA: Sigmoid-Enhanced CUR Decomposition with Uninterrupted Retention and Low-Rank Adaptation in Large Language Models 25 Feb 2025 · 0 repositories · arXiv:2502.18168
-
Theoretical Barriers in Bellman-Based Reinforcement Learning 17 Feb 2025 · 0 repositories · arXiv:2502.11968
-
Motion Control in Multi-Rotor Aerial Robots Using Deep Reinforcement Learning 9 Feb 2025 · 0 repositories · arXiv:2502.05996
-
TD3: Tucker Decomposition Based Dataset Distillation Method for Sequential Recommendation 5 Feb 2025 · 1 repository · arXiv:2502.02854
-
Actor Critic with Experience Replay-based automatic treatment planning for prostate cancer intensity modulated radiotherapy 1 Feb 2025 · 0 repositories · arXiv:2502.00346
-
Reward Prediction Error Prioritisation in Experience Replay: The RPE-PER Method 30 Jan 2025 · 0 repositories · arXiv:2501.18093
-
Langevin Soft Actor-Critic: Efficient Exploration through Uncertainty-Driven Critic Learning 29 Jan 2025 · 1 repository · arXiv:2501.17827Syntology official (archive's flag): 6 ran · 6 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
EvoRL: A GPU-accelerated Framework for Evolutionary Reinforcement Learning 25 Jan 2025 · 2 repositories · arXiv:2501.15129
-
Reinforcement Learning Controlled Adaptive PSO for Task Offloading in IIoT Edge Computing 25 Jan 2025 · 1 repository · arXiv:2501.15203
-
CLOFAI: A Dataset of Real And Fake Image Classification Tasks for Continual Learning 19 Jan 2025 · 1 repository · arXiv:2501.11140
-
Federated Deep Reinforcement Learning for Energy Efficient Multi-Functional RIS-Assisted Low-Earth Orbit Networks 19 Jan 2025 · 0 repositories · arXiv:2501.11079
-
Enhancing UAV Path Planning Efficiency Through Accelerated Learning 17 Jan 2025 · 0 repositories · arXiv:2501.10141
-
AutoLoop: Fast Visual SLAM Fine-tuning through Agentic Curriculum Learning 15 Jan 2025 · 0 repositories · arXiv:2501.09160
-
Dynamic Portfolio Optimization via Augmented DDPG with Quantum Price Levels-Based Trading Strategy 15 Jan 2025 · 0 repositories · arXiv:2501.08528
-
Continual Learning with Embedding Layer Surgery and Task-wise Beam Search using Whisper 14 Jan 2025 · 0 repositories · arXiv:2501.07875
-
Average Reward Reinforcement Learning for Wireless Radio Resource Management 12 Jan 2025 · 0 repositories · arXiv:2501.06700
-
SALE-Based Offline Reinforcement Learning with Ensemble Q-Networks 7 Jan 2025 · 0 repositories · arXiv:2501.03676
-
The Artificial Scientist -- in-transit Machine Learning of Plasma Simulations 6 Jan 2025 · 0 repositories · arXiv:2501.03383
-
Protein Structure Prediction in the 3D HP Model Using Deep Reinforcement Learning 29 Dec 2024 · 0 repositories · arXiv:2412.20329
-
Generalized Back-Stepping Experience Replay in Sparse-Reward Environments 20 Dec 2024 · 0 repositories · arXiv:2412.15525
-
An Advantage-based Optimization Method for Reinforcement Learning in Large Action Space 17 Dec 2024 · 0 repositories · arXiv:2412.12605
-
Distribution-Free Uncertainty Quantification in Mechanical Ventilation Treatment: A Conformal Deep Q-Learning Framework 17 Dec 2024 · 0 repositories · arXiv:2412.12597
-
Integrated Sensing and Communications for Low-Altitude Economy: A Deep Reinforcement Learning Approach 5 Dec 2024 · 0 repositories · arXiv:2412.04074
-
ONER: Online Experience Replay for Incremental Anomaly Detection 5 Dec 2024 · 0 repositories · arXiv:2412.03907
-
Continual Learning of Personalized Generative Face Models with Experience Replay 3 Dec 2024 · 0 repositories · arXiv:2412.02627
-
Dependency-Aware CAV Task Scheduling via Diffusion-Based Reinforcement Learning 27 Nov 2024 · 0 repositories · arXiv:2411.18230
-
Broad Critic Deep Actor Reinforcement Learning for Continuous Control 24 Nov 2024 · 0 repositories · arXiv:2411.15806
-
Provably Efficient Action-Manipulation Attack Against Continuous Reinforcement Learning 20 Nov 2024 · 0 repositories · arXiv:2411.13116
-
Dynamics of Resource Allocation in O-RANs: An In-depth Exploration of On-Policy and Off-Policy Deep Reinforcement Learning for Real-Time Applications 17 Nov 2024 · 0 repositories · arXiv:2412.01839
-
Quantum Policy Gradient in Reproducing Kernel Hilbert Space 11 Nov 2024 · 0 repositories · arXiv:2411.06650
-
Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning 5 Nov 2024 · 0 repositories · arXiv:2411.02983
-
Dynamic Weight Adjusting Deep Q-Networks for Real-Time Environmental Adaptation 4 Nov 2024 · 0 repositories · arXiv:2411.02559
-
Maximum Entropy Hindsight Experience Replay 31 Oct 2024 · 0 repositories · arXiv:2410.24016
-
Reinforcement Learning Gradients as Vitamin for Online Finetuning Decision Transformers 31 Oct 2024 · 1 repository · arXiv:2410.24108Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
NetworkGym: Reinforcement Learning Environments for Multi-Access Traffic Management in Network Simulation 30 Oct 2024 · 1 repository · arXiv:2411.04138Syntology official (archive's flag): 6 ran · 15 ran (of which 2 constructed an object rather than computing a result; 7 with no instrument failure: 4 honoured, 0 violated, 3 with no contract checked; 8 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples) · 1 pointer-only (licence)
-
Hindsight Experience Replay Accelerates Proximal Policy Optimization 29 Oct 2024 · 0 repositories · arXiv:2410.22524
-
Human-Readable Programs as Actors of Reinforcement Learning Agents Using Critic-Moderated Evolution 29 Oct 2024 · 1 repository · arXiv:2410.21940
-
Efficient Diversity-based Experience Replay for Deep Reinforcement Learning 27 Oct 2024 · 0 repositories · arXiv:2410.20487
-
Learn 2 Rage: Experiencing The Emotional Roller Coaster That Is Reinforcement Learning 24 Oct 2024 · 0 repositories · arXiv:2410.18462
-
Augmented Lagrangian-Based Safe Reinforcement Learning Approach for Distribution System Volt/VAR Control 19 Oct 2024 · 0 repositories · arXiv:2410.15188
-
Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replay 16 Oct 2024 · 0 repositories · arXiv:2410.12236
-
SAC-GLAM: Improving Online RL for LLM agents with Soft Actor-Critic and Hindsight Relabeling 16 Oct 2024 · 0 repositories · arXiv:2410.12481
-
Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functions 15 Oct 2024 · 0 repositories · arXiv:2410.11833
-
Physical Informed-Inspired Deep Reinforcement Learning Based Bi-Level Programming for Microgrid Scheduling 15 Oct 2024 · 0 repositories · arXiv:2410.11932
-
Solving The Dynamic Volatility Fitting Problem: A Deep Reinforcement Learning Approach 15 Oct 2024 · 0 repositories · arXiv:2410.11789
-
ETGL-DDPG: A Deep Deterministic Policy Gradient Algorithm for Sparse Reward Continuous Control 7 Oct 2024 · 0 repositories · arXiv:2410.05225
-
Task-free Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation 3 Oct 2024 · 0 repositories · arXiv:2410.02995
-
SSL-NBV: A Self-Supervised-Learning-Based Next-Best-View algorithm for Efficient 3D Plant Reconstruction by a Robot 2 Oct 2024 · 0 repositories · arXiv:2410.14790
-
Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning 28 Sep 2024 · 1 repository · arXiv:2409.19245Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Robust Deep Reinforcement Learning for Volt-VAR Optimization in Active Distribution System under Uncertainty 27 Sep 2024 · 0 repositories · arXiv:2409.18937
-
Navigation in a simplified Urban Flow through Deep Reinforcement Learning 26 Sep 2024 · 0 repositories · arXiv:2409.17922
-
CaBaGe: Data-Free Model Extraction using ClAss BAlanced Generator Ensemble 16 Sep 2024 · 0 repositories · arXiv:2409.10643
-
Learning Discrete World Models for Heuristic Search 14 Sep 2024 · 1 repository
-
Dynamic Demand Management for Parcel Lockers 8 Sep 2024 · 0 repositories · arXiv:2409.05061
-
Granular-ball Representation Learning for Deep CNN on Learning with Label Noise 5 Sep 2024 · 0 repositories · arXiv:2409.03254
-
A Tighter Convergence Proof of Reverse Experience Replay 30 Aug 2024 · 1 repository · arXiv:2408.16999
-
Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning 27 Aug 2024 · 0 repositories · arXiv:2408.15421
-
May the Forgetting Be with You: Alternate Replay for Learning with Noisy Labels 26 Aug 2024 · 1 repository · arXiv:2408.14284
-
Optimizing TD3 for 7-DOF Robotic Arm Grasping: Overcoming Suboptimality with Exploration-Enhanced Contrastive Learning 26 Aug 2024 · 0 repositories · arXiv:2408.14009
-
SigmaRL: A Sample-Efficient and Generalizable Multi-Agent Reinforcement Learning Framework for Motion Planning 14 Aug 2024 · 4 repositories · arXiv:2408.07644
Tasks archive 2025-07-28
20 shown of 289 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections