Methods › Reinforcement Learning › Policy Gradient Methods › TD3
Twin Delayed Deep Deterministic
TD3
Introduced by Scott Fujimoto et al. in Addressing Function Approximation Error in Actor-Critic Methods
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
TD3 builds on the DDPG algorithm for reinforcement learning, with a couple of modifications aimed at tackling overestimation bias with the value function. In particular, it utilises clipped double Q-learning, delayed update of target and policy networks, and target policy smoothing (which is similar to a SARSA based update; a safer update, as they provide higher value to actions resistant to perturbations).
Papers archive 2025-07-28
30 shown of 117, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Gradual Transition from Bellman Optimality Operator to Bellman Operator in Online Reinforcement Learning 6 Jun 2025 · 1 repository · arXiv:2506.05968Syntology ran 1 of 4 samples · 3 unverified
-
FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control 28 May 2025 · 0 repositories · arXiv:2505.22642
-
LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models 21 May 2025 · 0 repositories · arXiv:2505.15293
-
Monte Carlo Beam Search for Actor-Critic Reinforcement Learning in Continuous Control 13 May 2025 · 0 repositories · arXiv:2505.09029
-
Energy Efficient RSMA-Based LEO Satellite Communications Assisted by UAV-Mounted BD-Active RIS: A DRL Approach 7 May 2025 · 0 repositories · arXiv:2505.04148
-
AlphaGrad: Non-Linear Gradient Normalization Optimizer 22 Apr 2025 · 0 repositories · arXiv:2504.16020
-
Motion Control in Multi-Rotor Aerial Robots Using Deep Reinforcement Learning 9 Feb 2025 · 0 repositories · arXiv:2502.05996
-
TD3: Tucker Decomposition Based Dataset Distillation Method for Sequential Recommendation 5 Feb 2025 · 1 repository · arXiv:2502.02854
-
EvoRL: A GPU-accelerated Framework for Evolutionary Reinforcement Learning 25 Jan 2025 · 2 repositories · arXiv:2501.15129
-
Enhancing UAV Path Planning Efficiency Through Accelerated Learning 17 Jan 2025 · 0 repositories · arXiv:2501.10141
-
An Advantage-based Optimization Method for Reinforcement Learning in Large Action Space 17 Dec 2024 · 0 repositories · arXiv:2412.12605
-
Provably Efficient Action-Manipulation Attack Against Continuous Reinforcement Learning 20 Nov 2024 · 0 repositories · arXiv:2411.13116
-
Reinforcement Learning Gradients as Vitamin for Online Finetuning Decision Transformers 31 Oct 2024 · 1 repository · arXiv:2410.24108Syntology ran 0 of 7 samples · 7 unverified · 7 pointer-only (licence)
-
NetworkGym: Reinforcement Learning Environments for Multi-Access Traffic Management in Network Simulation 30 Oct 2024 · 1 repository · arXiv:2411.04138Syntology ran 9 of 18 samples · 9 unverified
-
Human-Readable Programs as Actors of Reinforcement Learning Agents Using Critic-Moderated Evolution 29 Oct 2024 · 1 repository · arXiv:2410.21940
-
Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functions 15 Oct 2024 · 0 repositories · arXiv:2410.11833
-
Navigation in a simplified Urban Flow through Deep Reinforcement Learning 26 Sep 2024 · 0 repositories · arXiv:2409.17922
-
Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning 27 Aug 2024 · 0 repositories · arXiv:2408.15421
-
Optimizing TD3 for 7-DOF Robotic Arm Grasping: Overcoming Suboptimality with Exploration-Enhanced Contrastive Learning 26 Aug 2024 · 0 repositories · arXiv:2408.14009
-
Image-Based Deep Reinforcement Learning with Intrinsically Motivated Stimuli: On the Execution of Complex Robotic Tasks 31 Jul 2024 · 0 repositories · arXiv:2407.21338
-
Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity 29 Jun 2024 · 0 repositories · arXiv:2407.09557
-
Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing 25 Jun 2024 · 0 repositories · arXiv:2407.02521
-
Value Improved Actor Critic Algorithms 3 Jun 2024 · 0 repositories · arXiv:2406.01423
-
Chaos-based reinforcement learning with TD3 15 May 2024 · 0 repositories · arXiv:2405.09086
-
Offline Reinforcement Learning with Behavioral Supervisor Tuning 25 Apr 2024 · 0 repositories · arXiv:2404.16399
-
RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models 11 Mar 2024 · 0 repositories · arXiv:2403.06420
-
Conservative DDPG -- Pessimistic RL without Ensemble 8 Mar 2024 · 0 repositories · arXiv:2403.05732
-
Fill-and-Spill: Deep Reinforcement Learning Policy Gradient Methods for Reservoir Operation Decision and Control 7 Mar 2024 · 0 repositories · arXiv:2403.04195
-
Snapshot Reinforcement Learning: Leveraging Prior Trajectories for Efficiency 1 Mar 2024 · 1 repository · arXiv:2403.00673
-
Exploiting Estimation Bias in Clipped Double Q-Learning for Continous Control Reinforcement Learning Tasks 14 Feb 2024 · 0 repositories · arXiv:2402.09078
Tasks archive 2025-07-28
20 shown of 69 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections