Papers › Comparing Observation and Action Representations for Deep Reinforcement Learning in $μ$RTS

Comparing Observation and Action Representations for Deep Reinforcement Learning in $μ$RTS

26 Oct 2019arXiv:1910.12134archive 2025-07-28

Shengyi Huang, Santiago Ontañón

This paper presents a preliminary study comparing different observation and action space representations for Deep Reinforcement Learning (DRL) in the context of Real-time Strategy (RTS) games. Specifically, we compare two representations: (1) a global representation where the observation represents the whole game state, and the RL agent needs to choose which unit to issue actions to, and which actions to execute; and (2) a local representation where the observation is represented from the point of view of an individual unit, and the RL agent picks actions for each unit independently. We evaluate these representations in μRTS showing that the local representation seems to outperform the global representation when training agents with the task of harvesting resources.

PaperPDFCode

Code

vwxyzjn/gym-microrts officialmentioned in papermentioned on GitHubpytorch report
changpowei/MicroRTS mentioned on GitHubpytorch report
farama-foundation/microrts-py mentioned on GitHubpytorch report
kered9/gym-microrts mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Deep Reinforcement LearningReinforcement LearningReinforcement Learning (RL)reinforcement-learning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections