Browse State-of-the-Art › SMAC
SMAC
54 papers with code · 11 benchmarks · 1 dataset archive 2025-07-28
The StarCraft Multi-Agent Challenge (SMAC) is a benchmark that provides elements of partial observability, challenging dynamics, and high-dimensional observation spaces. SMAC is built using the StarCraft II game engine, creating a testbed for research in cooperative MARL where each game unit is an independent RL agent.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
11 leaderboard tables shown for this task, 11 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 11 until expanded.
Syntology 2 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): SMAC MMM2 (2 judged, 0 placed), SMAC 3s5z_vs_3s6z (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
2 subtasks in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 121 · with a code link: 54 · where Syntology ran a sample: 13 (11 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (13 of 121 tagged: 11 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 121, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
11 Feb 2019 23 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 6 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples) · 14 pointer-only (licence)In this paper, we propose the StarCraft Multi-Agent Challenge (SMAC) as a benchmark problem to fill this gap.
-
18 Nov 2020 7 repositories listedMost recently developed approaches to cooperative multi-agent reinforcement learning in the centralized training with decentralized execution setting involve estimating a centralized, joint value function.
-
16 Oct 2019 4 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)We specifically focus on QMIX [40], the current state-of-the-art in this domain.
-
9 Mar 2017 4 repositories listedWe present mlrMBO, a flexible and comprehensive R toolbox for model-based optimization (MBO), also known as Bayesian optimization, which addresses the problem of expensive black-box optimization by approximating the…
-
14 Mar 2020 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)We propose FACtored Multi-Agent Centralised policy gradients (FACMAC), a new method for cooperative multi-agent reinforcement learning in both discrete and continuous action spaces.
-
6 Feb 2021 2 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Multi-Agent Reinforcement Learning (MARL) has seen revolutionary breakthroughs with its successful application to multi-agent cooperative tasks such as computer games and robot swarms.
-
20 Jun 2025 1 repository listedAdapting a single agent to a new multi-agent system brings challenges, necessitating adjustments across various tasks, environments, and interactions with unknown teammates and opponents.
-
9 Jun 2025 1 repository listedInspired by the success of curriculum learning (CL) in supervised tasks, we propose a dynamic CL framework for MARL that employs an self-adaptive difficulty adjustment mechanism.
-
10 May 2025 1 repository listedThe Multi-Agent RL Benchmark and Learning Environment for the Robotarium (MARBLER) is an exciting recent step in providing a standardized robotics-relevant platform for MARL, by bridging the Robotarium testbed with…
-
27 Mar 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Secondly, existing works only involve common skills and can not adaptively choose independent knowledge as task-specific skills in each task for fine-grained action execution.
-
7 Mar 2025 1 repository listedWe introduce Attentive VLM Agent (AVA), a multimodal StarCraft II agent that aligns artificial agent perception with the human gameplay experience.
-
7 Feb 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Multi-Agent Reinforcement Learning (MARL) has recently emerged as a significant area of research.
-
4 Feb 2025 1 repository listedSecond, we propose a novel hypernet regularizer on hypernetwork weights and biases to constrain the optimization of online global Q-network to prevent overestimation accumulation.
-
23 Dec 2024 1 repository listedSMAC-HARD supports customizable opponent strategies, randomization of adversarial policies, and interfaces for MARL self-play, enabling agents to generalize to varying opponent behaviors and improve model stability.
-
8 Nov 2024 1 repository listedThis paper introduces a new environment LLM-PySC2 (the Large Language Model StarCraft II Learning Environment), a platform derived from DeepMind's StarCraft II Learning Environment that serves to develop Large Language…
-
21 Oct 2024 1 repository listedStarCraft Multi-Agent Challenge (SMAC) is one of the most commonly used experimental environments in multi-agent reinforcement learning (MARL), where the specific task is to control a set number of allied units to…
-
3 Oct 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)With expansive state-action spaces, efficient multi-agent exploration remains a longstanding challenge in reinforcement learning.
-
12 Aug 2024 1 repository listedIn multi-agent cooperative tasks, the presence of heterogeneous agents is familiar.
-
22 Jun 2024 1 repository listedWe cast the dynamics learning as an auto-regressive sequence modeling problem over discrete tokens by leveraging the expressive Transformer architecture, in order to model complex local dynamics across different agents…
-
20 Jun 2024 1 repository listedIn this paper, we propose an enhancement to QMIX by incorporating an additional local Q-value learning method within the maximum entropy RL framework.
-
28 May 2024 1 repository listedIn multi-agent reinforcement learning (MARL), effective exploration is critical, especially in sparse reward environments.
-
20 May 2024 1 repository listedExtensive experiments on the SMAC benchmark demonstrate that MAZero outperforms model-free approaches in terms of sample efficiency and provides comparable or better performance than existing model-based methods in…
-
5 Mar 2024 1 repository listedAgents share Q-value network periodically during the training process.
-
22 Aug 2023 1 repository listedRecently, deep multi-agent reinforcement learning (MARL) has gained significant popularity due to its success in various cooperative multi-agent tasks.
-
7 Aug 2023 1 repository listedTraditional methods, like grid search and Bayesian optimization, often struggle to quickly adapt and efficiently search the loss landscape.
-
4 Jun 2023 1 repository listedIn fully cooperative multi-agent reinforcement learning (MARL) settings, environments are highly stochastic due to the partial observability of each agent and the continuously changing policies of other agents.
-
10 May 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples)Concretely, to avoid the ego-system overfitting to a specific attacker, we maintain a set of attackers, which is optimized to guarantee the attackers high attacking quality and behavior diversity.
-
9 May 2023 1 repository listedThe Starcraft Multi-Agent Challenge (SMAC) has been widely used in MARL research, but is built on top of a heavy, closed-source computer game, StarCraft II.
-
2 Mar 2023 1 repository listedWe firstly define and describe the heterogeneous problems in SMAC.
-
7 Feb 2023 1 repository listedTo achieve maximum deviation in victim policies under complex agent-wise interactions, our unilateral attack aims to characterize and maximize the impact of the adversary on the victims.
-
5 Jan 2023 1 repository listed
-
14 Dec 2022 1 repository listed
-
10 Dec 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
29 Nov 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
23 Nov 2022 1 repository listed
-
22 Nov 2022 1 repository listed
-
3 Oct 2022 1 repository listed Syntology official (archive's flag): 5 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
15 Aug 2022 1 repository listed
-
25 May 2022 1 repository listed
-
9 Dec 2021 1 repository listed
-
6 Dec 2021 1 repository listed
-
31 May 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
16 Feb 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
20 Jan 2021 1 repository listed
-
22 Dec 2020 1 repository listed
-
21 Nov 2020 1 repository listed
-
9 Oct 2020 1 repository listed
-
6 Oct 2020 1 repository listed
-
19 Jun 2020 1 repository listed
-
19 Mar 2020 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
11 Nov 2019 1 repository listed
-
15 Apr 2019 1 repository listed
-
3 Jan 2019 1 repository listed
-
Efficient Hyperparameter Optimization of Deep Learning Algorithms Using Deterministic RBF Surrogates28 Jul 2016 1 repository listed
-
Ensemble-MIX: Enhancing Sample Efficiency in Multi-Agent RL Using Ensemble Methods3 Jun 2025 0 repositories listed
-
Dynamic Sight Range Selection in Multi-Agent Reinforcement Learning19 May 2025 0 repositories listed
-
POCAII: Parameter Optimization with Conscious Allocation using Iterative Intelligence16 May 2025 0 repositories listed
-
Rainbow Delay Compensation: A Multi-Agent Reinforcement Learning Framework for Mitigating Delayed Observation6 May 2025 0 repositories listed
-
Low-Rank Agent-Specific Adaptation (LoRASA) for Multi-Agent Policy Learning8 Feb 2025 0 repositories listed
-
O-MAPL: Offline Multi-agent Preference Learning31 Jan 2025 0 repositories listed
-
BLAST: A Stealthy Backdoor Leverage Attack against Cooperative Multi-Agent Deep Reinforcement Learning based Systems3 Jan 2025 0 repositories listed
-
Offline-to-Online Multi-Agent Reinforcement Learning with Offline Value Function Memory and Sequential Exploration25 Oct 2024 0 repositories listed
-
A Safety Modulator Actor-Critic Method in Model-Free Safe Reinforcement Learning and Application in UAV Hovering9 Oct 2024 0 repositories listed
-
A Spatiotemporal Stealthy Backdoor Attack against Cooperative Multi-Agent Deep Reinforcement Learning12 Sep 2024 0 repositories listed
-
Diffusion-based Episodes Augmentation for Offline Multi-Agent Reinforcement Learning23 Aug 2024 0 repositories listed
-
Improving Global Parameter-sharing in Physically Heterogeneous Multi-agent Reinforcement Learning with Unified Action Space14 Aug 2024 0 repositories listed
-
CuDA2: An approach for Incorporating Traitor Agents into Cooperative Multi-Agent Systems25 Jun 2024 0 repositories listed
-
Higher Replay Ratio Empowers Sample-Efficient Multi-Agent Reinforcement Learning15 Apr 2024 0 repositories listed
-
Heterogeneous Multi-Agent Reinforcement Learning for Zero-Shot Scalable Collaboration5 Apr 2024 0 repositories listed
-
Better Understandings and Configurations in MaxSAT Local Search Solvers via Anytime Performance Analysis11 Mar 2024 0 repositories listed
-
Imagine, Initialize, and Explore: An Effective Exploration Method in Multi-Agent Reinforcement Learning28 Feb 2024 0 repositories listed
-
Aligning Individual and Collective Objectives in Multi-Agent Cooperation19 Feb 2024 0 repositories listed
-
Enabling Multi-Agent Transfer Reinforcement Learning via Scenario Independent Representation13 Feb 2024 0 repositories listed
-
MAIDCRL: Semi-centralized Multi-Agent Influence Dense-CNN Reinforcement Learning12 Feb 2024 0 repositories listed
-
Poisson Process for Bayesian Optimization5 Feb 2024 0 repositories listed
-
T2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integration19 Jan 2024 0 repositories listed
-
AgentMixer: Multi-Agent Correlated Policy Factorization16 Jan 2024 0 repositories listed
-
Innate-Values-driven Reinforcement Learning based Cooperative Multi-Agent Cognitive Modeling10 Jan 2024 0 repositories listed
-
How much can change in a year? Revisiting Evaluation in Multi-Agent Reinforcement Learning13 Dec 2023 0 repositories listed
-
QFree: A Universal Value Function Factorization for Multi-Agent Reinforcement Learning1 Nov 2023 0 repositories listed
-
MaskMA: Towards Zero-Shot Multi-Agent Decision Making with Mask-Based Collaborative Learning18 Oct 2023 0 repositories listed
-
Privacy-Engineered Value Decomposition Networks for Cooperative Multi-Agent Reinforcement Learning13 Sep 2023 0 repositories listed
-
Research on Multi-Agent Communication and Collaborative Decision-Making Based on Deep Reinforcement Learning23 May 2023 0 repositories listed
-
MABL: Bi-Level Latent-Variable World Model for Sample-Efficient Multi-Agent Reinforcement Learning12 Apr 2023 0 repositories listed
-
Automated classification of pre-defined movement patterns: A comparison between GNSS and UWB technology10 Mar 2023 0 repositories listed
-
Contextual Transformer for Offline Meta Reinforcement Learning15 Nov 2022 0 repositories listed
-
PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning17 Oct 2022 0 repositories listed
-
Maximum Correntropy Value Decomposition for Multi-agent Deep Reinforcemen Learning7 Aug 2022 0 repositories listed
-
Policy Diagnosis via Measuring Role Diversity in Cooperative Multi-agent RL1 Jun 2022 0 repositories listed
-
Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning11 May 2022 0 repositories listed
-
Towards Comprehensive Testing on the Robustness of Cooperative Multi-agent Reinforcement Learning17 Apr 2022 0 repositories listed
-
Breaking the Curse of Dimensionality in Multiagent State Space: A Unified Agent Permutation Framework10 Mar 2022 0 repositories listed
-
Depthwise Convolution for Multi-Agent Communication with Enhanced Mean-Field Approximation6 Mar 2022 0 repositories listed
-
Exploiting Semantic Epsilon Greedy Exploration Strategy in Multi-Agent Reinforcement Learning26 Jan 2022 0 repositories listed
-
A Comparative study of Hyper-Parameter Optimization Tools17 Jan 2022 0 repositories listed
-
Local Advantage Networks for Cooperative Multi-Agent Reinforcement Learning23 Dec 2021 0 repositories listed
-
State-based Episodic Memory for Multi-Agent Reinforcement Learning19 Oct 2021 0 repositories listed
-
MARNET: Backdoor Attacks against Value-Decomposition Multi-Agent Reinforcement Learning29 Sep 2021 0 repositories listed
-
Revisiting the Monotonicity Constraint in Cooperative Multi-Agent Reinforcement Learning29 Sep 2021 0 repositories listed
-
Role Diversity Matters: A Study of Cooperative Training Strategies for Multi-Agent RL29 Sep 2021 0 repositories listed
Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections