Multi-agent Reinforcement Learning

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

9 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 522 papers with code (1,718 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
  7 Jun 2017 86 repositories listed Syntology ran 75 of 143 samples · 68 unverified · 99 pointer-only (licence)
  We explore deep reinforcement learning methods for multi-agent domains.
• The StarCraft Multi-Agent Challenge
  11 Feb 2019 23 repositories listed Syntology ran 6 of 15 samples · 9 unverified · 13 pointer-only (licence)
  In this paper, we propose the StarCraft Multi-Agent Challenge (SMAC) as a benchmark problem to fill this gap.
• The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Games
  2 Mar 2021 19 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  This is often due to the belief that PPO is significantly less sample efficient than off-policy methods in multi-agent systems.
• QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning
  30 Mar 2018 18 repositories listed Syntology ran 9 of 11 samples · 2 unverified · 6 pointer-only (licence)
  At the same time, it is often possible to train the agents in a centralised fashion in a simulated or laboratory setting, where global state information is available and communication constraints are lifted.
• Trust Region Policy Optimisation in Multi-Agent Reinforcement Learning
  23 Sep 2021 11 repositories listed Syntology ran 2 of 5 samples · 3 unverified
  In this paper, we extend the theory of trust region learning to MARL.
• Value-Decomposition Networks For Cooperative Multi-Agent Learning
  16 Jun 2017 10 repositories listed
  We study the problem of cooperative multi-agent reinforcement learning with a single joint reward signal.
• RLCard: A Toolkit for Reinforcement Learning in Card Games
  10 Oct 2019 9 repositories listed Syntology ran 1 of 5 samples · 4 unverified
  The goal of RLCard is to bridge reinforcement learning and imperfect information games, and push forward the research of reinforcement learning in domains with multiple agents, large state and action space, and sparse…
• Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?
  18 Nov 2020 7 repositories listed
  Most recently developed approaches to cooperative multi-agent reinforcement learning in the \emph{centralized training with decentralized execution} setting involve estimating a centralized, joint value function.
• QPLEX: Duplex Dueling Multi-Agent Q-Learning
  3 Aug 2020 6 repositories listed Syntology ran 2 of 4 samples · 2 unverified
  This paper presents a novel MARL approach, called duPLEX dueling multi-agent Q-learning (QPLEX), which takes a duplex dueling network architecture to factorize the joint value function.
• Learning with Opponent-Learning Awareness
  13 Sep 2017 6 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  We also show that the LOLA update rule can be efficiently calculated using an extension of the policy gradient estimator, making the method suitable for model-free RL.
• SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Driving
  19 Oct 2020 5 repositories listed Syntology ran 0 of 5 samples · 5 unverified · 5 pointer-only (licence)
  We open-source the SMARTS platform and the associated benchmark tasks and evaluation metrics to encourage and empower research on multi-agent learning for autonomous driving.
• Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents
  23 Feb 2018 5 repositories listed
  To this end, we propose two decentralized actor-critic algorithms with function approximation, which are applicable to large-scale MARL problems where both the number of states and the number of agents are massively…
• Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
  28 Feb 2017 5 repositories listed
  Many real-world problems, such as network packet routing and urban traffic control, are naturally modeled as multi-agent reinforcement learning (RL) problems.
• SigmaRL: A Sample-Efficient and Generalizable Multi-Agent Reinforcement Learning Framework for Motion Planning
  14 Aug 2024 4 repositories listed
  Most RL agents exhibit a limited capacity to generalize, often focusing narrowly on specific scenarios, and are usually evaluated in similar or even the same scenarios seen during training.
• DeCOM: Decomposed Policy for Constrained Cooperative Multi-Agent Reinforcement Learning
  10 Nov 2021 4 repositories listed
  In addition, with such modularization, the training algorithm of DeCOM separates the original constrained optimization into an unconstrained optimization on reward and a constraints satisfaction problem on costs.
• Multi-Agent Constrained Policy Optimisation
  6 Oct 2021 4 repositories listed Syntology ran 1 of 7 samples · 6 unverified · 1 pointer-only (licence)
  To fill these gaps, in this work, we formulate the safe MARL problem as a constrained Markov game and solve it with policy optimisation methods.
• Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learning
  21 Jun 2020 4 repositories listed Syntology ran 0 of 5 samples · 5 unverified
  In this work we aim to solve this problem by optimizing the efficiency and resource utilization of reinforcement learning algorithms instead of relying on distributed computation.
• Weighted QMIX: Expanding Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning
  18 Jun 2020 4 repositories listed
  We show in particular that this projection can fail to recover the optimal policy even with access to Q^*, which primarily stems from the equal weighting placed on each joint action.
• Simplified Action Decoder for Deep Multi-Agent Reinforcement Learning
  4 Dec 2019 4 repositories listed
  Learning to be informative when observed by others is an interesting challenge for Reinforcement Learning (RL): Fundamentally, RL requires agents to explore in order to discover good policies.
• MAVEN: Multi-Agent Variational Exploration
  16 Oct 2019 4 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 2 pointer-only (licence)
  We specifically focus on QMIX [40], the current state-of-the-art in this domain.
• Learning Transferable Cooperative Behavior in Multi-Agent Teams
  4 Jun 2019 4 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  While multi-agent interactions can be naturally modeled as a graph, the environment has traditionally been considered as a black box.
• QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learning
  14 May 2019 4 repositories listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  We explore value-based solutions for multi-agent reinforcement learning (MARL) tasks in the centralized training with decentralized execution (CTDE) regime popularized recently.
• CoLight: Learning Network-level Cooperation for Traffic Signal Control
  11 May 2019 4 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  To enable cooperation of traffic signals, in this paper, we propose a model, CoLight, which uses graph attentional networks to facilitate communication.
• A multi-agent reinforcement learning model of common-pool resource appropriation
  20 Jul 2017 4 repositories listed
  Here we show that deep reinforcement learning can be used instead.
• Multi-agent Reinforcement Learning in Sequential Social Dilemmas
  10 Feb 2017 4 repositories listed
  We introduce sequential social dilemmas that share the mixed incentive structure of matrix game social dilemmas but also require agents to learn policies that implement their strategic intentions.
• JaxMARL: Multi-Agent RL Environments and Algorithms in JAX
  16 Nov 2023 3 repositories listed Syntology ran 0 of 23 samples · 23 unverified
  Benchmarks are crucial in the development of machine learning algorithms, with available environments significantly influencing reinforcement learning (RL) research.
• Deep Reinforcement Learning for Multi-Agent Interaction
  2 Aug 2022 3 repositories listed
  The development of autonomous agents which can interact with other agents to accomplish a given task is a core area of research in artificial intelligence and machine learning.
• The Shapley Value in Machine Learning
  11 Feb 2022 3 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Over the last few years, the Shapley value, a solution concept from cooperative game theory, has found numerous applications in machine learning.
• WarpDrive: Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning on a GPU
  31 Aug 2021 3 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  We present WarpDrive, a flexible, lightweight, and easy-to-use open-source RL framework that implements end-to-end deep multi-agent RL on a single GPU (Graphics Processing Unit), built on PyCUDA and PyTorch.
• Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Control
  3 Mar 2021 3 repositories listed
  Robotic simulators are crucial for academic research and education as well as the development of safety-critical applications.

Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.