Methods › Reinforcement Learning › Policy Gradient Methods › A2C
A2C
Introduced by Volodymyr Mnih et al. in Asynchronous Methods for Deep Reinforcement Learning
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
A2C, or Advantage Actor Critic, is a synchronous version of the A3C policy gradient method. As an alternative to the asynchronous implementation of A3C, A2C is a synchronous, deterministic implementation that waits for each actor to finish its segment of experience before updating, averaging over all of the actors. This more effectively uses GPUs due to larger batch sizes.
Image Credit: OpenAI Baselines
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: KG-A2C; MORL-A2C; Larch-A2C; Diffusion A2C (DA2C); Federated Temporal Graph Convolutional Network with Advantage Actor-Critic (Federated TGCN-A2C).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 82 · with a code link: 27 · where Syntology ran a sample: 12 (11 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (12 of 82 tagged: 11 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 82 of 82, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Monte Carlo Beam Search for Actor-Critic Reinforcement Learning in Continuous Control 13 May 2025 · 0 repositories · arXiv:2505.09029
-
Ensemble RL through Classifier Models: Enhancing Risk-Return Trade-offs in Trading Strategies 23 Feb 2025 · 0 repositories · arXiv:2502.17518
-
Continuous Learning Conversational AI: A Personalized Agent Framework via A2C Reinforcement Learning 18 Feb 2025 · 0 repositories · arXiv:2502.12876
-
EvoRL: A GPU-accelerated Framework for Evolutionary Reinforcement Learning 25 Jan 2025 · 2 repositories · arXiv:2501.15129
-
Innate-Values-driven Reinforcement Learning based Cognitive Modeling 14 Nov 2024 · 0 repositories · arXiv:2411.09160
-
Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity 29 Jun 2024 · 0 repositories · arXiv:2407.09557
-
Multistep Criticality Search and Power Shaping in Microreactors with Reinforcement Learning 22 Jun 2024 · 0 repositories · arXiv:2406.15931
-
Biological Neurons Compete with Deep Reinforcement Learning in Sample Efficiency in a Simulated Gameworld 27 May 2024 · 0 repositories · arXiv:2405.16946
-
Symmetric Reinforcement Learning Loss for Robust Learning on Diverse Tasks and Model Scales 27 May 2024 · 1 repository · arXiv:2405.17618
-
Extracting Heuristics from Large Language Models for Reward Shaping in Reinforcement Learning 24 May 2024 · 0 repositories · arXiv:2405.15194
-
Portfolio Management using Deep Reinforcement Learning 1 May 2024 · 0 repositories · arXiv:2405.01604
-
Breaching the Bottleneck: Evolutionary Transition from Reward-Driven Learning to Reward-Agnostic Domain-Adapted Learning in Neuromodulated Neural Nets 19 Apr 2024 · 1 repository · arXiv:2404.12631
-
A2C: A Modular Multi-stage Collaborative Decision Framework for Human-AI Teams 25 Jan 2024 · 0 repositories · arXiv:2401.14432
-
Epidemic Decision-making System Based Federated Reinforcement Learning 3 Nov 2023 · 0 repositories · arXiv:2311.01749
-
Diagnosis-oriented Medical Image Compression with Efficient Transfer Learning 20 Oct 2023 · 0 repositories · arXiv:2310.13250
-
Deep Reinforcement Learning-based Intelligent Traffic Signal Controls with Optimized CO2 emissions 19 Oct 2023 · 1 repository · arXiv:2310.13129
-
Solving the Quadratic Assignment Problem using Deep Reinforcement Learning 2 Oct 2023 · 0 repositories · arXiv:2310.01604
-
Raijū: Reinforcement Learning-Guided Post-Exploitation for Automating Security Assessment of Network Systems 27 Sep 2023 · 0 repositories · arXiv:2309.15518
-
SAF-Net: Self-Attention Fusion Network for Myocardial Infarction Detection using Multi-View Echocardiography 27 Sep 2023 · 0 repositories · arXiv:2309.15520
-
Career Path Recommendations for Long-term Income Maximization: A Reinforcement Learning Approach 11 Sep 2023 · 0 repositories · arXiv:2309.05391
-
Semantic Consistency for Assuring Reliability of Large Language Models 17 Aug 2023 · 0 repositories · arXiv:2308.09138
-
Deep Reinforcement Learning for ESG financial portfolio management 19 Jun 2023 · 0 repositories · arXiv:2307.09631
-
Multi-Agent Reinforcement Learning for Network Routing in Integrated Access Backhaul Networks 12 May 2023 · 0 repositories · arXiv:2305.16170
-
Deep reinforcement learning applied to an assembly sequence planning problem with user preferences 13 Apr 2023 · 0 repositories · arXiv:2304.06567
-
Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals 9 Feb 2023 · 0 repositories · arXiv:2302.04449
-
A Scale-Independent Multi-Objective Reinforcement Learning with Convergence Analysis 8 Feb 2023 · 0 repositories · arXiv:2302.04179
-
Learning, Fast and Slow: A Goal-Directed Memory-Based Approach for Dynamic Environments 31 Jan 2023 · 1 repository · arXiv:2301.13758
-
Towards automating Codenames spymasters with deep reinforcement learning 28 Dec 2022 · 0 repositories · arXiv:2212.14104
-
Reinforcement Learning for Molecular Dynamics Optimization: A Stochastic Pontryagin Maximum Principle Approach 6 Dec 2022 · 1 repository · arXiv:2212.03320
-
Towards More Efficient Shared Autonomous Mobility: A Learning-Based Fleet Repositioning Approach 16 Oct 2022 · 0 repositories · arXiv:2210.08659
-
Reinforcement Learning for Cognitive Delay/Disruption Tolerant Network Node Management in an LEO-based Satellite Constellation 27 Sep 2022 · 0 repositories · arXiv:2209.13237
-
Variance Reduction for Policy-Gradient Methods via Empirical Variance Minimization 14 Jun 2022 · 0 repositories · arXiv:2206.06827
-
A2C is a special case of PPO 18 May 2022 · 1 repository · arXiv:2205.09123
-
Cliff Diving: Exploring Reward Surfaces in Reinforcement Learning Environments 14 May 2022 · 0 repositories · arXiv:2205.07015Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Consistent Dropout for Policy Gradient Reinforcement Learning 23 Feb 2022 · 0 repositories · arXiv:2202.11818
-
Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving 20 Jan 2022 · 0 repositories · arXiv:2201.08116
-
Recursive Least Squares Advantage Actor-Critic Algorithms 15 Jan 2022 · 0 repositories · arXiv:2201.05918
-
Early Myocardial Infarction Detection over Multi-view Echocardiography 9 Nov 2021 · 1 repository · arXiv:2111.05790
-
Structure-aware reinforcement learning for node-overload protection in mobile edge computing 29 Jun 2021 · 0 repositories · arXiv:2107.01025
-
Learning to Plan via a Multi-Step Policy Regression Method 18 Jun 2021 · 0 repositories · arXiv:2106.10075
-
Towards Practical Credit Assignment for Deep Reinforcement Learning 8 Jun 2021 · 0 repositories · arXiv:2106.04499
-
Deep Reinforcement Learning for Adaptive Exploration of Unknown Environments 4 May 2021 · 1 repository · arXiv:2105.01606
-
A review of motion planning algorithms for intelligent robotics 4 Feb 2021 · 0 repositories · arXiv:2102.02376
-
Deep Coherent Exploration For Continuous Control 1 Jan 2021 · 0 repositories
-
Optimizing Information Bottleneck in Reinforcement Learning: A Stein Variational Approach 1 Jan 2021 · 0 repositories
-
Augmenting Policy Learning with Routines Discovered from a Single Demonstration 23 Dec 2020 · 2 repositories · arXiv:2012.12469Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance 19 Nov 2020 · 6 repositories · arXiv:2011.09607
-
Tonic: A Deep Reinforcement Learning Library for Fast Prototyping and Benchmarking 15 Nov 2020 · 1 repository · arXiv:2011.07537Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
The Greatest Teacher, Failure is: Using Reinforcement Learning for SFC Placement Based on Availability and Energy Consumption 12 Oct 2020 · 0 repositories · arXiv:2010.05711
-
Value-Decomposition Multi-Agent Actor-Critics 24 Jul 2020 · 1 repository · arXiv:2007.12306
-
Smooth Exploration for Robotic Reinforcement Learning 12 May 2020 · 4 repositories · arXiv:2005.05719Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Work in Progress: Temporally Extended Auxiliary Tasks 1 Apr 2020 · 0 repositories · arXiv:2004.00600
-
PFPN: Continuous Control of Physically Simulated Characters using Particle Filtering Policy Network 16 Mar 2020 · 1 repository · arXiv:2003.06959
-
Addressing Some Limitations of Transformers with Feedback Memory 21 Feb 2020 · 4 repositories · arXiv:2002.09402Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Learning Representations in Reinforcement Learning: an Information Bottleneck Approach 1 Jan 2020 · 0 repositories
-
SLM Lab: A Comprehensive Benchmark and Modular Software Framework for Reproducible Deep Reinforcement Learning 28 Dec 2019 · 1 repository · arXiv:1912.12482Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples)
-
Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning 13 Nov 2019 · 0 repositories · arXiv:1911.05281
-
Learning Representations in Reinforcement Learning:An Information Bottleneck Approach 12 Nov 2019 · 0 repositories · arXiv:1911.05695
-
AI Assisted Annotator using Reinforcement Learning 2 Oct 2019 · 0 repositories · arXiv:1910.02052
-
QuaRL: Quantization for Fast and Environmentally Sustainable Reinforcement Learning 2 Oct 2019 · 1 repository · arXiv:1910.01055Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Improving OOV Detection and Resolution with External Language Models in Acoustic-to-Word ASR 22 Sep 2019 · 0 repositories · arXiv:1909.09993
-
Deep Reinforcement Learning with Modulated Hebbian plus Q Network Architecture 21 Sep 2019 · 1 repository · arXiv:1909.09902
-
Vision-based Navigation Using Deep Reinforcement Learning 8 Aug 2019 · 1 repository · arXiv:1908.03627
-
Variance Reduction in Actor Critic Methods (ACM) 23 Jul 2019 · 0 repositories · arXiv:1907.09765
-
Gossip-based Actor-Learner Architectures for Deep Reinforcement Learning 9 Jun 2019 · 1 repository · arXiv:1906.04585
-
RL-Based Method for Benchmarking the Adversarial Resilience and Robustness of Deep Reinforcement Learning Policies 3 Jun 2019 · 0 repositories · arXiv:1906.01110
-
Deep Q-Learning with Q-Matrix Transfer Learning for Novel Fire Evacuation Environment 23 May 2019 · 0 repositories · arXiv:1905.09673
-
Autonomous Air Traffic Controller: A Deep Multi-Agent Reinforcement Learning Approach 2 May 2019 · 0 repositories · arXiv:1905.01303
-
Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Control 11 Mar 2019 · 1 repository · arXiv:1903.04527Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
Integrating Reinforcement Learning to Self Training for Pulmonary Nodule Segmentation in Chest X-rays 21 Nov 2018 · 0 repositories · arXiv:1811.08840
-
An initial attempt of combining visual selective attention with deep reinforcement learning 11 Nov 2018 · 0 repositories · arXiv:1811.04407
-
Representation Learning with Contrastive Predictive Coding 10 Jul 2018 · 28 repositories · arXiv:1807.03748Syntology 35 ran (of which 21 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 5 where Syntology's instrument failed) · 10 unverified (of 45 harvested samples) · 22 pointer-only (licence)
-
An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution 9 Jul 2018 · 24 repositories · arXiv:1807.03247Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Improving width-based planning with compact policies 15 Jun 2018 · 0 repositories · arXiv:1806.05898
-
Deep Curiosity Search: Intra-Life Exploration Can Improve Performance on Challenging Deep Reinforcement Learning Problems 1 Jun 2018 · 0 repositories · arXiv:1806.00553
-
An Empirical Analysis of Proximal Policy Optimization with Kronecker-factored Natural Gradients 17 Jan 2018 · 0 repositories · arXiv:1801.05566
-
Exploring Deep Recurrent Models with Reinforcement Learning for Molecule Design 1 Jan 2018 · 0 repositories
-
A Benchmarking Environment for Reinforcement Learning Based Task Oriented Dialogue Management 29 Nov 2017 · 0 repositories · arXiv:1711.11023
-
AI Safety Gridworlds 27 Nov 2017 · 2 repositories · arXiv:1711.09883
-
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning 31 Oct 2017 · 0 repositories · arXiv:1710.11277
-
TreeQN and ATreeC: Differentiable Tree-Structured Models for Deep Reinforcement Learning 31 Oct 2017 · 1 repository · arXiv:1710.11417Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
Asynchronous Methods for Deep Reinforcement Learning 4 Feb 2016 · 70 repositories · arXiv:1602.01783Syntology 60 ran (of which 20 constructed an object rather than computing a result; 50 with no instrument failure: 2 honoured, 1 violated, 47 with no contract checked; 10 where Syntology's instrument failed) · 35 unverified (of 95 harvested samples) · 20 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 86 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections