Papers › Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?

Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?

18 Nov 2020arXiv:2011.09533archive 2025-07-28

Christian Schroeder de Witt, Tarun Gupta, Denys Makoviichuk, Viktor Makoviychuk, Philip H. S. Torr, Mingfei Sun, Shimon Whiteson

Most recently developed approaches to cooperative multi-agent reinforcement learning in the \emph{centralized training with decentralized execution} setting involve estimating a centralized, joint value function. In this paper, we demonstrate that, despite its various theoretical shortcomings, Independent PPO (IPPO), a form of independent learning in which each agent simply estimates its local value function, can perform just as well as or better than state-of-the-art joint learning approaches on popular multi-agent benchmark suite SMAC with little hyperparameter tuning. We also compare IPPO to several variants; the results suggest that IPPO's strong performance may be due to its robustness to some forms of environment non-stationarity.

PaperPDFCode

In Syntology View this paper on Syntology: its page in Syntology's graph, with its repositories and citations.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

16444take/aope-sim mentioned on GitHubpytorch report
cyanrain7/trpo-in-marl mentioned on GitHubpytorch report
facebookresearch/benchmarl mentioned on GitHubpytorchMIT report
morning9393/HAPPO-HATRPO mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AllMulti-agent Reinforcement LearningReinforcement Learning (RL)SMACSMAC+Starcraftreinforcement-learning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Entropy RegularizationPPO

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections