Methods › Reinforcement Learning › Policy Gradient Methods › DDPG
Deep Deterministic Policy Gradient
DDPG
Introduced by Timothy P. Lillicrap et al. in Continuous control with deep reinforcement learning
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
DDPG, or Deep Deterministic Policy Gradient, is an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. It combines the actor-critic approach with insights from DQNs: in particular, the insights that 1) the network is trained off-policy with samples from a replay buffer to minimize correlations between samples, and 2) the network is trained with a target Q network to give consistent targets during temporal difference backups. DDPG makes use of the same ideas along with batch normalization.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: GAN-DDPG; Soft DDPG; Hawkes-CT DDPG; DDPG framework; Domain Knowledge-Informed DDPG (DKDDPG); Average Reward Off-Policy Deep Deterministic Policy Gradient (ARO-DDPG) Algorithm.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 218 · with a code link: 71 · where Syntology ran a sample: 14 (13 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (14 of 218 tagged: 13 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 3: papers 1 to 100 of 218, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Multi-Objective Reinforcement Learning for Cognitive Radar Resource Management 25 Jun 2025 · 0 repositories · arXiv:2506.20853
-
Reliable Critics: Monotonic Improvement and Convergence Guarantees for Reinforcement Learning 8 Jun 2025 · 0 repositories · arXiv:2506.07134
-
A Novel Deep Reinforcement Learning Method for Computation Offloading in Multi-User Mobile Edge Computing with Decentralization 3 Jun 2025 · 0 repositories · arXiv:2506.02458
-
LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models 21 May 2025 · 0 repositories · arXiv:2505.15293
-
Deep reinforcement learning-based longitudinal control strategy for automated vehicles at signalised intersections 13 May 2025 · 0 repositories · arXiv:2505.08896
-
Moderate Actor-Critic Methods: Controlling Overestimation Bias via Expectile Loss 14 Apr 2025 · 0 repositories · arXiv:2504.09929
-
Intelligent Joint Security and Delay Determinacy Performance Guarantee Strategy in RIS-Assisted IIoT Communication Systems 11 Mar 2025 · 0 repositories · arXiv:2503.08086
-
EvoRL: A GPU-accelerated Framework for Evolutionary Reinforcement Learning 25 Jan 2025 · 2 repositories · arXiv:2501.15129
-
Federated Deep Reinforcement Learning for Energy Efficient Multi-Functional RIS-Assisted Low-Earth Orbit Networks 19 Jan 2025 · 0 repositories · arXiv:2501.11079
-
AutoLoop: Fast Visual SLAM Fine-tuning through Agentic Curriculum Learning 15 Jan 2025 · 0 repositories · arXiv:2501.09160
-
Dynamic Portfolio Optimization via Augmented DDPG with Quantum Price Levels-Based Trading Strategy 15 Jan 2025 · 0 repositories · arXiv:2501.08528
-
An Advantage-based Optimization Method for Reinforcement Learning in Large Action Space 17 Dec 2024 · 0 repositories · arXiv:2412.12605
-
Broad Critic Deep Actor Reinforcement Learning for Continuous Control 24 Nov 2024 · 0 repositories · arXiv:2411.15806
-
Provably Efficient Action-Manipulation Attack Against Continuous Reinforcement Learning 20 Nov 2024 · 0 repositories · arXiv:2411.13116
-
Quantum Policy Gradient in Reproducing Kernel Hilbert Space 11 Nov 2024 · 0 repositories · arXiv:2411.06650
-
Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functions 15 Oct 2024 · 0 repositories · arXiv:2410.11833
-
ETGL-DDPG: A Deep Deterministic Policy Gradient Algorithm for Sparse Reward Continuous Control 7 Oct 2024 · 0 repositories · arXiv:2410.05225
-
Robust Deep Reinforcement Learning for Volt-VAR Optimization in Active Distribution System under Uncertainty 27 Sep 2024 · 0 repositories · arXiv:2409.18937
-
FH-DRL: Exponential-Hyperbolic Frontier Heuristics with DRL for accelerated Exploration in Unknown Environments 26 Jul 2024 · 0 repositories · arXiv:2407.18892
-
The Cross-environment Hyperparameter Setting Benchmark for Reinforcement Learning 26 Jul 2024 · 0 repositories · arXiv:2407.18840
-
Reconfigurable Intelligent Surface Aided Vehicular Edge Computing: Joint Phase-shift Optimization and Multi-User Power Allocation 18 Jul 2024 · 1 repository · arXiv:2407.13123
-
Deep reinforcement learning with symmetric data augmentation applied for aircraft lateral attitude tracking control 13 Jul 2024 · 0 repositories · arXiv:2407.11077
-
Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity 29 Jun 2024 · 0 repositories · arXiv:2407.09557
-
Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing 25 Jun 2024 · 0 repositories · arXiv:2407.02521
-
Towards Dynamic Resource Allocation and Client Scheduling in Hierarchical Federated Learning: A Two-Phase Deep Reinforcement Learning Approach 21 Jun 2024 · 0 repositories · arXiv:2406.14910
-
Value Improved Actor Critic Algorithms 3 Jun 2024 · 0 repositories · arXiv:2406.01423
-
Meta Reinforcement Learning for Resource Allocation in Multi-Antenna UAV Network with Rate Splitting Multiple Access 18 May 2024 · 0 repositories · arXiv:2405.11306
-
Continuous Control Reinforcement Learning: Distributed Distributional DrQ Algorithms 16 Apr 2024 · 0 repositories · arXiv:2404.10645
-
Conservative DDPG -- Pessimistic RL without Ensemble 8 Mar 2024 · 0 repositories · arXiv:2403.05732
-
Fill-and-Spill: Deep Reinforcement Learning Policy Gradient Methods for Reservoir Operation Decision and Control 7 Mar 2024 · 0 repositories · arXiv:2403.04195
-
Model Free Deep Deterministic Policy Gradient Controller for Setpoint Tracking of Non-minimum Phase Systems 27 Feb 2024 · 0 repositories · arXiv:2402.17703
-
FlowPG: Action-constrained Policy Gradient with Normalizing Flows 7 Feb 2024 · 1 repository · arXiv:2402.05149
-
MinMaxMin Q-learning 3 Feb 2024 · 0 repositories · arXiv:2402.05951
-
SQT -- std Q-target 3 Feb 2024 · 0 repositories · arXiv:2402.05950
-
Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information 29 Jan 2024 · 0 repositories · arXiv:2401.15848
-
AI-enabled Priority and Auction-Based Spectrum Management for 6G 12 Jan 2024 · 0 repositories · arXiv:2401.06484
-
Adaptive Discounting of Training Time Attacks 5 Jan 2024 · 0 repositories · arXiv:2401.02652
-
Multiagent Copilot Approach for Shared Autonomy between Human EEG and TD3 Deep Reinforcement Learning 22 Dec 2023 · 0 repositories · arXiv:2312.14458
-
Dynamic Fairness-Aware Spectrum Auction for Enhanced Licensed Shared Access in 6G Networks 20 Dec 2023 · 0 repositories · arXiv:2312.12867
-
Contextual Reinforcement Learning for Offshore Wind Farm Bidding 18 Dec 2023 · 0 repositories · arXiv:2312.10884
-
Enhancing Robotic Navigation: An Evaluation of Single and Multi-Objective Reinforcement Learning Strategies 13 Dec 2023 · 0 repositories · arXiv:2312.07953
-
Finite Horizon Multi-Agent Reinforcement Learning in Solving Optimal Control of State-Dependent Switched Systems 8 Dec 2023 · 0 repositories · arXiv:2312.04767
-
Epidemic Decision-making System Based Federated Reinforcement Learning 3 Nov 2023 · 0 repositories · arXiv:2311.01749
-
Distributional Soft Actor-Critic with Three Refinements 9 Oct 2023 · 2 repositories · arXiv:2310.05858Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Energy Management in a Cooperative Energy Harvesting Wireless Sensor Network 9 Oct 2023 · 0 repositories · arXiv:2310.05911
-
CAD: Clustering And Deep Reinforcement Learning Based Multi-Period Portfolio Management Strategy 2 Oct 2023 · 0 repositories · arXiv:2310.01319
-
Enhancing data efficiency in reinforcement learning: a novel imagination mechanism based on mesh information propagation 25 Sep 2023 · 2 repositories · arXiv:2309.14243
-
A Long N-step Surrogate Stage Reward for Deep Reinforcement Learning 21 Sep 2023 · 0 repositories
-
Double Gumbel Q-Learning 21 Sep 2023 · 1 repository
-
Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventions 20 Sep 2023 · 0 repositories · arXiv:2309.10980
-
Vehicles Control: Collision Avoidance using Federated Deep Reinforcement Learning 4 Aug 2023 · 0 repositories · arXiv:2308.02614
-
Exploring reinforcement learning techniques for discrete and continuous control tasks in the MuJoCo environment 20 Jul 2023 · 1 repository · arXiv:2307.11166
-
Safe Reinforcement Learning for Strategic Bidding of Virtual Power Plants in Day-Ahead Markets 11 Jul 2023 · 0 repositories · arXiv:2307.05812
-
Safety-Aware Task Composition for Discrete and Continuous Reinforcement Learning 29 Jun 2023 · 0 repositories · arXiv:2306.17033
-
Action and Trajectory Planning for Urban Autonomous Driving with Hierarchical Reinforcement Learning 28 Jun 2023 · 0 repositories · arXiv:2306.15968
-
Safe, Efficient, Comfort, and Energy-saving Automated Driving through Roundabout Based on Deep Reinforcement Learning 20 Jun 2023 · 0 repositories · arXiv:2306.11465
-
On Practical Robust Reinforcement Learning: Practical Uncertainty Set and Double-Agent Algorithm 11 May 2023 · 0 repositories · arXiv:2305.06657
-
Simple Noisy Environment Augmentation for Reinforcement Learning 4 May 2023 · 1 repository · arXiv:2305.02882
-
Federated Deep Reinforcement Learning for THz-Beam Search with Limited CSI 25 Apr 2023 · 0 repositories · arXiv:2304.13109
-
Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach 11 Apr 2023 · 0 repositories · arXiv:2304.12184
-
Energy Management of Multi-mode Plug-in Hybrid Electric Vehicle using Multi-agent Deep Reinforcement Learning 16 Mar 2023 · 0 repositories · arXiv:2303.09658
-
A Strategy-Oriented Bayesian Soft Actor-Critic Model 7 Mar 2023 · 0 repositories · arXiv:2303.04193
-
Combating Uncertainties in Wind and Distributed PV Energy Sources Using Integrated Reinforcement Learning and Time-Series Forecasting 27 Feb 2023 · 0 repositories · arXiv:2302.14094
-
Revisiting the Gumbel-Softmax in MADDPG 23 Feb 2023 · 1 repository · arXiv:2302.11793
-
UAV Path Planning Employing MPC- Reinforcement Learning Method Considering Collision Avoidance 21 Feb 2023 · 0 repositories · arXiv:2302.10669
-
Smart 6G Sky for Green Mobile IOT Networks 15 Feb 2023 · 1 repository · arXiv:2302.09022
-
RIS-Assisted Jamming Rejection and Path Planning for UAV-Borne IoT Platform: A New Deep Reinforcement Learning Framework 10 Feb 2023 · 0 repositories · arXiv:2302.04994
-
Deep Reinforcement Learning for Traffic Light Control in Intelligent Transportation Systems 4 Feb 2023 · 0 repositories · arXiv:2302.03669
-
V2N Service Scaling with Deep Reinforcement Learning 30 Jan 2023 · 0 repositories · arXiv:2301.13324
-
A Novel Deep Reinforcement Learning-based Approach for Enhancing Spectral Efficiency of IRS-assisted Wireless Systems 24 Jan 2023 · 0 repositories · arXiv:2302.14706
-
On the Geometry of Reinforcement Learning in Continuous State and Action Spaces 29 Dec 2022 · 0 repositories · arXiv:2301.00009
-
Off-Policy Deep Reinforcement Learning Algorithms for Handling Various Robotic Manipulator Tasks 11 Dec 2022 · 0 repositories · arXiv:2212.05572
-
CACTO: Continuous Actor-Critic with Trajectory Optimization -- Towards global optimality 12 Nov 2022 · 0 repositories · arXiv:2211.06625
-
Wind Power Forecasting Considering Data Privacy Protection: A Federated Deep Reinforcement Learning Approach 2 Nov 2022 · 0 repositories · arXiv:2211.02674
-
AACHER: Assorted Actor-Critic Deep Reinforcement Learning with Hindsight Experience Replay 24 Oct 2022 · 1 repository · arXiv:2210.12892
-
Multiagent Reinforcement Learning Based on Fusion-Multiactor-Attention-Critic for Multiple-Unmanned-Aerial-Vehicle Navigation Control 10 Oct 2022 · 1 repository
-
Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning 7 Oct 2022 · 0 repositories · arXiv:2210.03469
-
Minimizing Human Assistance: Augmenting a Single Demonstration for Deep Reinforcement Learning 22 Sep 2022 · 0 repositories · arXiv:2209.11275
-
Goal-Conditioned Q-Learning as Knowledge Distillation 28 Aug 2022 · 1 repository · arXiv:2208.13298
-
Bayesian Soft Actor-Critic: A Directed Acyclic Strategy Graph Based Deep Reinforcement Learning 11 Aug 2022 · 2 repositories · arXiv:2208.06033
-
Plug-and-Play Model-Agnostic Counterfactual Policy Synthesis for Deep Reinforcement Learning based Recommendation 10 Aug 2022 · 0 repositories · arXiv:2208.05142
-
Performance Comparison of Deep RL Algorithms for Energy Systems Optimal Scheduling 1 Aug 2022 · 1 repository · arXiv:2208.00728
-
Distributional Actor-Critic Ensemble for Uncertainty-Aware Continuous Control 27 Jul 2022 · 0 repositories · arXiv:2207.13730
-
Abstract Demonstrations and Adaptive Exploration for Efficient and Stable Multi-step Sparse Reward Reinforcement Learning 19 Jul 2022 · 1 repository · arXiv:2207.09243
-
Autonomous Platoon Control with Integrated Deep Reinforcement Learning and Dynamic Programming 15 Jun 2022 · 0 repositories · arXiv:2206.07536
-
Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach 13 Jun 2022 · 0 repositories · arXiv:2206.05881
-
Joint Energy Dispatch and Unit Commitment in Microgrids Based on Deep Reinforcement Learning 3 Jun 2022 · 0 repositories · arXiv:2206.01663
-
Truly Deterministic Policy Optimization 30 May 2022 · 1 repository · arXiv:2205.15379
-
Multiple Domain Cyberspace Attack and Defense Game Based on Reward Randomization Reinforcement Learning 23 May 2022 · 0 repositories · arXiv:2205.10990
-
Hybrid Reinforcement Learning for STAR-RISs: A Coupled Phase-Shift Model Based Beamformer 10 May 2022 · 0 repositories · arXiv:2205.05029
-
Revisiting Gaussian mixture critics in off-policy reinforcement learning: a sample-based approach 21 Apr 2022 · 1 repository · arXiv:2204.10256
-
Confidence Estimation Transformer for Long-term Renewable Energy Forecasting in Reinforcement Learning-based Power Grid Dispatching 10 Apr 2022 · 1 repository · arXiv:2204.04612
-
Collaborative Intelligent Reflecting Surface Networks with Multi-Agent Reinforcement Learning 26 Mar 2022 · 0 repositories · arXiv:2203.14152
-
Non-Parametric Stochastic Policy Gradient with Strategic Retreat for Non-Stationary Environment 24 Mar 2022 · 0 repositories · arXiv:2203.14905
-
MicroRacer: a didactic environment for Deep Reinforcement Learning 20 Mar 2022 · 1 repository · arXiv:2203.10494
-
Designing Heterogeneous GNNs with Desired Permutation Properties for Wireless Resource Allocation 8 Mar 2022 · 0 repositories · arXiv:2203.03906
-
AI-based Robust Resource Allocation in End-to-End Network Slicing under Demand and CSI Uncertainties 10 Feb 2022 · 0 repositories · arXiv:2202.05131
-
skrl: Modular and Flexible Library for Reinforcement Learning 8 Feb 2022 · 1 repository · arXiv:2202.03825
-
DDPG-Driven Deep-Unfolding with Adaptive Depth for Channel Estimation with Sparse Bayesian Learning 20 Jan 2022 · 0 repositories · arXiv:2201.08477
-
Critic Algorithms using Cooperative Networks 19 Jan 2022 · 0 repositories · arXiv:2201.07839
Tasks archive 2025-07-28
20 shown of 88 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections