Methods › Reinforcement Learning › Off-Policy TD Control › Q-Learning
Q-Learning
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Q-Learning is an off-policy temporal difference control algorithm:
Q(Sₜ, Aₜ) ←Q(Sₜ, Aₜ) + α[Rₜ₊₁ + γmaxₐQ(Sₜ₊₁, a) - Q(Sₜ, Aₜ)]
The learned action-value function Q directly approximates q_*, the optimal action-value function, independent of the policy being followed.
Source: Sutton and Barto, Reinforcement Learning, 2nd Edition
Papers archive 2025-07-28
30 shown of 1,734, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Detecting and Mitigating Reward Hacking in Reinforcement Learning Systems: A Comprehensive Empirical Study 8 Jul 2025 · 0 repositories · arXiv:2507.05619
-
2048: Reinforcement Learning in a Delayed Reward Environment 7 Jul 2025 · 0 repositories · arXiv:2507.05465
-
VRAIL: Vectorized Reward-based Attribution for Interpretable Learning 19 Jun 2025 · 0 repositories · arXiv:2506.16014
-
Reinforcement Learning-Based Policy Optimisation For Heterogeneous Radio Access 18 Jun 2025 · 0 repositories · arXiv:2506.15273
-
GCN-Driven Reinforcement Learning for Probabilistic Real-Time Guarantees in Industrial URLLC 17 Jun 2025 · 0 repositories · arXiv:2506.15011
-
Implicit Constraint-Aware Off-Policy Correction for Offline Reinforcement Learning 16 Jun 2025 · 0 repositories · arXiv:2506.14058
-
ReinDSplit: Reinforced Dynamic Split Learning for Pest Recognition in Precision Agriculture 16 Jun 2025 · 0 repositories · arXiv:2506.13935
-
"What are my options?": Explaining RL Agents with Diverse Near-Optimal Alternatives (Extended) 11 Jun 2025 · 0 repositories · arXiv:2506.09901
-
Reliable Critics: Monotonic Improvement and Convergence Guarantees for Reinforcement Learning 8 Jun 2025 · 0 repositories · arXiv:2506.07134
-
Bridging the Performance Gap Between Target-Free and Target-Based Reinforcement Learning With Iterated Q-Learning 4 Jun 2025 · 0 repositories · arXiv:2506.04398
-
Improving Performance of Spike-based Deep Q-Learning using Ternary Neurons 3 Jun 2025 · 0 repositories · arXiv:2506.03392
-
Getting More from Less: Transfer Learning Improves Sleep Stage Decoding Accuracy in Peripheral Wearable Devices 31 May 2025 · 0 repositories · arXiv:2506.00730
-
Reinforcement Learning for Hanabi 31 May 2025 · 0 repositories · arXiv:2506.00458
-
Combining Deep Architectures for Information Gain estimation and Reinforcement Learning for multiagent field exploration 29 May 2025 · 0 repositories · arXiv:2505.23865
-
On Global Convergence Rates for Federated Policy Gradient under Heterogeneous Environment 29 May 2025 · 0 repositories · arXiv:2505.23459
-
BOFormer: Learning to Solve Multi-Objective Bayesian Optimization via Non-Markovian RL 28 May 2025 · 0 repositories · arXiv:2505.21974
-
A General-Purpose Theorem for High-Probability Bounds of Stochastic Approximation with Polyak Averaging 27 May 2025 · 0 repositories · arXiv:2505.21796
-
The Cell Must Go On: Agar.io for Continual Reinforcement Learning 23 May 2025 · 1 repository · arXiv:2505.18347
-
Offline Guarded Safe Reinforcement Learning for Medical Treatment Optimization Strategies 22 May 2025 · 0 repositories · arXiv:2505.16242
-
Reinforcement Learning for Stock Transactions 22 May 2025 · 0 repositories · arXiv:2505.16099
-
LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models 21 May 2025 · 0 repositories · arXiv:2505.15293
-
OPA-Pack: Object-Property-Aware Robotic Bin Packing 19 May 2025 · 0 repositories · arXiv:2505.13339
-
When a Reinforcement Learning Agent Encounters Unknown Unknowns 19 May 2025 · 0 repositories · arXiv:2505.13188
-
Imagination-Limited Q-Learning for Offline Reinforcement Learning 18 May 2025 · 0 repositories · arXiv:2505.12211
-
ShiQ: Bringing back Bellman to LLMs 16 May 2025 · 0 repositories · arXiv:2505.11081
-
Automatic Reward Shaping from Confounded Offline Data 16 May 2025 · 0 repositories · arXiv:2505.11478
-
Bias or Optimality? Disentangling Bayesian Inference and Learning Biases in Human Decision-Making 12 May 2025 · 0 repositories · arXiv:2505.08049
-
Convert Language Model into a Value-based Strategic Planner 11 May 2025 · 0 repositories · arXiv:2505.06987
-
A Large Language Model-Enhanced Q-learning for Capacitated Vehicle Routing Problem with Time Windows 9 May 2025 · 0 repositories · arXiv:2505.06178
-
Reinforcement Learning for Game-Theoretic Resource Allocation on Graphs 8 May 2025 · 0 repositories · arXiv:2505.06319
Tasks archive 2025-07-28
20 shown of 393 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections