Papers › Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model

Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model

19 Nov 2019arXiv:1911.08265archive 2025-07-28

Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, Laurent SIfre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, Timothy Lillicrap, David Silver

Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods have enjoyed huge success in challenging domains, such as chess and Go, where a perfect simulator is available. However, in real-world problems the dynamics governing the environment are often complex and unknown. In this work we present the MuZero algorithm which, by combining a tree-based search with a learned model, achieves superhuman performance in a range of challenging and visually complex domains, without any knowledge of their underlying dynamics. MuZero learns a model that, when applied iteratively, predicts the quantities most directly relevant to planning: the reward, the action-selection policy, and the value function. When evaluated on 57 different Atari games - the canonical video game environment for testing AI techniques, in which model-based planning approaches have historically struggled - our new algorithm achieved a new state of the art. When evaluated on Go, chess and shogi, without any knowledge of the game rules, MuZero matched the superhuman performance of the AlphaZero algorithm that was supplied with the game rules.

PaperPDFCodeCode Syntology ranMethod as code

In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

Syntology 64 code samples harvested from 7 repositories linked to this paper: 43 ran (of which 36 constructed an object rather than computing a result; 43 with no instrument failure: 4 honoured, 0 violated, 39 with no contract checked; 0 where Syntology's instrument failed) · 21 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code; here there are none.

By repository: community (archive-listed): 64 samples from 7 repositories, 43 ran (43 with no instrument failure; 0 where Syntology's instrument failed). The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

No sample is linked to this paper from 2 of its repositories that Syntology harvested for other papers:

Levels written between 2026-09-22 and 2026-09-24 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed.

18 repositories listed; official and paper-mentioned ones first.

DHDev0/Muzero mentioned on GitHubpytorchSyntology: 9 samples, 7 ran (0 instrument-failed) · 2 unverified report
JuanCCS/muzero-jc mentioned on GitHubpytorchSyntology: not harvested report
Miatto-research-group/muzero mentioned on GitHubpytorchSyntology: 9 samples, 7 ran (0 instrument-failed) · 2 unverified report
SHRIVP/muzero mentioned on GitHubtfSyntology: not harvested report
YuriCat/MuZeroJupyterExample mentioned on GitHubSyntology: not harvested report
Zeta36/muzero mentioned on GitHubpytorchSyntology: 8 samples, 8 ran (0 instrument-failed) · 0 unverified report
ZiyuanMa/reversi mentioned on GitHubpytorchSyntology: not harvested report
colindbrown/columbia-deep-learning-project mentioned on GitHubpytorchSyntology: not harvested report
dmiracle/muzero-starter mentioned on GitHubtfSyntology: 28 samples, 14 ran (0 instrument-failed) · 14 unverified report
foersterrobert/MuZero mentioned on GitHubpytorchSyntology: 6 samples, 5 ran (0 instrument-failed) · 1 unverified report
johan-gras/MuZero mentioned on GitHubtfSyntology: not harvested report
k-lombard/CS4641_Project mentioned on GitHubtfSyntology: not harvested report
k-lombard/Deep-Learning-Chess-AI mentioned on GitHubtfSyntology: not harvested report
kaesve/muzero mentioned on GitHubtfSyntology: not harvested report
koulanurag/muzero-pytorch mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
opendilab/LightZero mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to One Model for All Tasks: Leveraging Efficient World Models in Multi-Task Planning (arXiv:2509.07945; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
snjstudent/MyMuzero mentioned on GitHubtfSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
werner-duvaud/muzero-general mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Mastering Atari Games with Limited Data (arXiv:2111.00210; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

64 samples harvested: 43 ran (of which 36 constructed an object rather than computing a result; 43 with no instrument failure: 4 honoured, 0 violated, 39 with no contract checked; 0 where Syntology's instrument failed) · 21 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. That date is not when the samples ran.

4ran · honoured contract
39ran
21unverified

Licence: 62 of the 64 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 7 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 6 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.

Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity. A census tag appears when Syntology's census ran implementations with that name on one shared input per bucket: it gives how many were compared, from how many papers, and how many distinct outputs they produced, and names this sample's bucket when this sample was one of them.

DHDev0/Muzero community (archive-listed) 9 samples, 7 ran (0 instrument-failed) · 2 unverified
Dynamics_function muzero_model.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · f350ba73bb2b6c49 · report fixture: returned Dynamics_function · level recorded 2026-09-22
Gym_space_transform muzero_model.py ran GPL-3.0 (copyleft) · pointer only · 2163d21945e117d2 · report fixture: returned Gym_space_transform · level recorded 2026-09-22
Loss_function muzero_model.py ran GPL-3.0 (copyleft) · pointer only · 3c443470e4e1a53e · report fixture: returned Loss_function · level recorded 2026-09-22
Prediction_function muzero_model.py ran · metamorphic tier: deterministic fingerprinted GPL-3.0 (copyleft) · pointer only · f494f13eb22d701c · report fixture: returned Prediction_function · level recorded 2026-09-22
Representation_function muzero_model.py ran · metamorphic tier: deterministic fingerprinted GPL-3.0 (copyleft) · pointer only · a6b5b641f84a85a8 · report fixture: returned Representation_function · level recorded 2026-09-22
l2 in 38 papers
census: 5 implementations from 7 papers, 4 distinct outputs across 3 buckets, one shared input per bucket
muzero_model.py ran · honoured contract GPL-3.0 (copyleft) · pointer only · 130559f2af719d4c · report fixture: signature models:list/1/callable, l2_weight_decay:float/0/float · returned Tensor · level recorded 2026-09-22
scale_to_bound_action muzero_model.py ran · honoured contract fingerprinted GPL-3.0 (copyleft) · pointer only · b8f46926e70c3faf · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
Muzero muzero_model.py unverified GPL-3.0 (copyleft) · pointer only · af8bd591fad76cfd · report
weights_init in 44 papers muzero_model.py unverified GPL-3.0 (copyleft) · pointer only · 4a1372219a8f271f · report
Miatto-research-group/muzero community (archive-listed) 9 samples, 7 ran (0 instrument-failed) · 2 unverified
Dynamics muzero.py ran no licence file found · pointer only · 30d4d7d24de54388 · report fixture: returned Dynamics · level recorded 2026-09-22
Episode muzero.py ran no licence file found · pointer only · af3e096bbf7db489 · report fixture: returned Episode · level recorded 2026-09-22
MDP muzero.py ran no licence file found · pointer only · 8fda00742ff79300 · report fixture: returned MDP · level recorded 2026-09-22
Network in 40 papers muzero.py ran no licence file found · pointer only · 350296e8e546c436 · report fixture: returned Network · level recorded 2026-09-22
Node in 32 papers muzero.py ran no licence file found · pointer only · 5c75c7c9c180b73f · report fixture: returned Node · level recorded 2026-09-22
Prediction muzero.py ran no licence file found · pointer only · 22e39aaf897c5ae2 · report fixture: signature state:Tensor/3/float · returned tuple · level recorded 2026-09-24
Representation muzero.py ran no licence file found · pointer only · 31b7161c4ce14024 · report fixture: returned Representation · level recorded 2026-09-22
Game muzero.py unverified no licence file found · pointer only · 13c74e7e84599c32 · report
Muzero muzero.py unverified no licence file found · pointer only · cc8d0217186545a5 · report
Zeta36/muzero community (archive-listed) 8 samples, 8 ran (0 instrument-failed) · 0 unverified
Action in 10 papers muzero.py ran GPL-3.0 (copyleft) · pointer only · a2a9ed20152a3952 · report fixture: returned Action · level recorded 2026-09-22
Conv in 30 papers
census: 8 implementations from 8 papers, 8 distinct outputs across 2 buckets, one shared input per bucket
muzero.py ran · metamorphic tier: deterministic fingerprinted GPL-3.0 (copyleft) · pointer only · 54a71cf4bd44cdb5 · report fixture: returned Conv · level recorded 2026-09-22
Dynamics muzero.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · cdddcdc3c7ca7abd · report fixture: returned Dynamics · level recorded 2026-09-22
Network in 40 papers muzero.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · b325291e54b512ea · report fixture: returned Network · level recorded 2026-09-22
NetworkOutput muzero.py ran GPL-3.0 (copyleft) · pointer only · c00d34318df332ef · report fixture: returned NetworkOutput · level recorded 2026-09-22
Prediction muzero.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · a545ea9c6da33b3b · report fixture: returned Prediction · level recorded 2026-09-22
Representation muzero.py ran · metamorphic tier: deterministic fingerprinted GPL-3.0 (copyleft) · pointer only · 7c65617a096f3525 · report fixture: returned Representation · level recorded 2026-09-22
ResidualBlock in 100 papers muzero.py ran GPL-3.0 (copyleft) · pointer only · 697fbe33b6749d85 · report fixture: returned ResidualBlock · level recorded 2026-09-22
dmiracle/muzero-starter community (archive-listed) 28 samples, 14 ran (0 instrument-failed) · 14 unverified
Action in 10 papers pseudocode.py ran no licence file found · pointer only · 6c89f46298706981 · report fixture: returned Action · level recorded 2026-09-22
ActionHistory pseudocode.py ran no licence file found · pointer only · e8337fef1f2be2db · report fixture: returned ActionHistory · level recorded 2026-09-22
Environment pseudocode.py ran no licence file found · pointer only · ef2d84c53dd4b44c · report fixture: returned Environment · level recorded 2026-09-22
Game pseudocode.py ran no licence file found · pointer only · de896b106de5476f · report fixture: returned Game · level recorded 2026-09-22
MinMaxStats pseudocode.py ran no licence file found · pointer only · 56fa35bdc3d1ed2d · report fixture: returned MinMaxStats · level recorded 2026-09-22
MuZeroConfig pseudocode.py ran no licence file found · pointer only · 3e343c7b7c4786ff · report fixture: returned MuZeroConfig · level recorded 2026-09-22
Network in 40 papers pseudocode.py ran no licence file found · pointer only · 5ca30608329df48f · report fixture: signature image:ndarray/3/float · returned NetworkOutput · level recorded 2026-09-24
NetworkOutput pseudocode.py ran no licence file found · pointer only · 298dd8d5ebffe115 · report fixture: returned NetworkOutput · level recorded 2026-09-22
Node in 32 papers pseudocode.py ran no licence file found · pointer only · f69c690385c860bb · report fixture: returned Node · level recorded 2026-09-22
Player pseudocode.py ran no licence file found · pointer only · 89236c13c0330206 · report fixture: returned Player · level recorded 2026-09-22
SharedStorage pseudocode.py ran no licence file found · pointer only · 610fcab4b0c9cbd1 · report fixture: returned SharedStorage · level recorded 2026-09-22
make_uniform_network pseudocode.py ran no licence file found · pointer only · 00effc9a1425b666 · report fixture: returned Network · level recorded 2026-09-22
scalar_loss pseudocode.py ran · honoured contract fingerprinted no licence file found · pointer only · a6399bbbf15a6cf9 · report fixture: signature prediction:Tensor/2/float, target:Tensor/2/float · returned int · level recorded 2026-09-22
softmax_sample pseudocode.py ran · honoured contract fingerprinted no licence file found · pointer only · 5f8447d8f24a2352 · report fixture: signature distribution:Tensor/2/float, temperature:float/0/float · returned tuple · level recorded 2026-09-22
ReplayBuffer in 33 papers pseudocode.py unverified no licence file found · pointer only · 6ff1fe24a95ea773 · report
add_exploration_noise pseudocode.py unverified no licence file found · pointer only · 75647f5246c855a9 · report
backpropagate pseudocode.py unverified no licence file found · pointer only · 66fa0db77edfb84f · report
expand_node pseudocode.py unverified no licence file found · pointer only · 68325e020744ad6b · report
launch_job pseudocode.py unverified no licence file found · pointer only · c14a803ab75d12e0 · report
muzero pseudocode.py unverified no licence file found · pointer only · 8e9b0cff26418aa0 · report
play_game pseudocode.py unverified no licence file found · pointer only · 57de20801e4ede5e · report
run_mcts pseudocode.py unverified no licence file found · pointer only · cbc81cda9608e263 · report
run_selfplay pseudocode.py unverified no licence file found · pointer only · 315c1446112d1012 · report
select_action in 22 papers pseudocode.py unverified no licence file found · pointer only · fe46ed855a1faead · report
select_child pseudocode.py unverified no licence file found · pointer only · 683480d2bfbfe612 · report
train_network in 7 papers pseudocode.py unverified no licence file found · pointer only · abc403d4436aa68a · report
ucb_score pseudocode.py unverified no licence file found · pointer only · 5ab7b336cd84f817 · report
update_weights pseudocode.py unverified no licence file found · pointer only · 69a7fb6acc0e52bd · report
foersterrobert/MuZero community (archive-listed) 6 samples, 5 ran (0 instrument-failed) · 1 unverified
DiscreteSupport Environments/CarRacing/model.py ran no licence file found · pointer only · e54e936724993d90 · report fixture: returned DiscreteSupport · level recorded 2026-09-22
DynamicsFunction Environments/CarRacing/model.py ran · metamorphic tier: deterministic no licence file found · pointer only · cbc3bb0d9250d6be · report fixture: returned DynamicsFunction · level recorded 2026-09-22
PredictionFunction Environments/CarRacing/model.py ran · metamorphic tier: deterministic no licence file found · pointer only · c2e1dd48bfa01608 · report fixture: returned PredictionFunction · level recorded 2026-09-22
RepresentationFunction Environments/CarRacing/model.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · 4af5cddce927144e · report fixture: returned RepresentationFunction · level recorded 2026-09-22
ResBlock in 127 papers
census: 6 implementations from 5 papers, 6 distinct outputs across 2 buckets, one shared input per bucket
Environments/CarRacing/model.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · 4cac665725b2396a · report fixture: returned ResBlock · level recorded 2026-09-22
MuZero Environments/CarRacing/model.py unverified no licence file found · pointer only · ebb3d8aed0e0cff6 · report
koulanurag/muzero-pytorch community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
MinMaxStats core/mcts.py ran MIT (permissive) · be0ba3624e7c8b19 · report fixture: returned MinMaxStats · level recorded 2026-09-22
MCTS in 15 papers core/mcts.py unverified MIT (permissive) · 54758c22e1156b77 · report
snjstudent/MyMuzero community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
Residual_Block model_muzero.py ran no licence file found · pointer only · 9870e1b665456b71 · report fixture: returned Residual_Block · level recorded 2026-09-22
MuZero_Model model_muzero.py unverified no licence file found · pointer only · abfe4355cbd8718d · report

Method as code Syntology

What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. Siblings are assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another.

7 assemblies on this paper: 7 harvested, 0 generated, listed in 1 groups (siblings lifted in one batch form one group).

7 sibling assemblies for MuZero (harvested), lifted in the same batch on 2026-09-09: alternative readings kept side by side; none replaces or supersedes another.

harvested Assembly for MuZero (graph method: MuZero). 6 bricks; individually on a fixture: 5 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 5 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 7 siblings

  1. MuZero entry · level 0 · unverified · ebb3d8aed0e0cff6
  2. DiscreteSupport helper · level 1 · ran · e54e936724993d90
  3. DynamicsFunction model · level 1 · ran · cbc3bb0d9250d6be
  4. PredictionFunction model · level 1 · ran · c2e1dd48bfa01608
  5. RepresentationFunction model · level 1 · ran · 4af5cddce927144e
  6. ResBlock helper · level 1 · ran · 4cac665725b2396a

harvested Assembly for MuZero (graph method: MuZero). 9 bricks; individually on a fixture: 7 ran (of which 5 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified. The assembly has not been run end-to-end.

one of 7 siblings

  1. Muzero entry · level 0 · unverified · af8bd591fad76cfd
  2. Dynamics_function helper · level 1 · ran · f350ba73bb2b6c49
  3. Gym_space_transform data_transform · level 1 · ran · 2163d21945e117d2
  4. Loss_function helper · level 1 · ran · 3c443470e4e1a53e
  5. Prediction_function helper · level 1 · ran · f494f13eb22d701c
  6. Representation_function helper · level 1 · ran · a6b5b641f84a85a8
  7. l2 helper · level 1 · ran · honoured contract · 130559f2af719d4c
  8. weights_init helper · level 0 · unverified · 4a1372219a8f271f
  9. scale_to_bound_action helper · level 1 · ran · honoured contract · b8f46926e70c3faf

harvested Assembly for MuZero (graph method: MuZero). 8 bricks; individually on a fixture: 8 ran (of which 8 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 8 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 7 siblings

  1. Network entry · level 1 · ran · b325291e54b512ea
  2. Dynamics model · level 1 · ran · cdddcdc3c7ca7abd
  3. NetworkOutput helper · level 1 · ran · c00d34318df332ef
  4. Prediction model · level 1 · ran · a545ea9c6da33b3b
  5. Representation model · level 1 · ran · 7c65617a096f3525
  6. Conv helper · level 1 · ran · 54a71cf4bd44cdb5
  7. ResidualBlock helper · level 1 · ran · 697fbe33b6749d85
  8. Action helper · level 1 · ran · a2a9ed20152a3952

harvested Assembly for MuZero (graph method: MuZero). 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 7 siblings

  1. MuZero_Model entry · level 0 · unverified · abfe4355cbd8718d
  2. Residual_Block model · level 1 · ran · 9870e1b665456b71

harvested Assembly for MuZero (graph method: MuZero). 9 bricks; individually on a fixture: 7 ran (of which 6 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified. The assembly has not been run end-to-end.

one of 7 siblings

  1. Muzero entry · level 0 · unverified · cc8d0217186545a5
  2. Episode helper · level 1 · ran · af3e096bbf7db489
  3. Network model · level 1 · ran · 350296e8e546c436
  4. Dynamics helper · level 1 · ran · 30d4d7d24de54388
  5. Prediction helper · level 1 · ran · 22e39aaf897c5ae2
  6. Representation helper · level 1 · ran · 31b7161c4ce14024
  7. Node helper · level 1 · ran · 5c75c7c9c180b73f
  8. Game helper · level 0 · unverified · 13c74e7e84599c32
  9. MDP helper · level 1 · ran · 8fda00742ff79300

harvested Assembly for MuZero (graph method: MuZero). 28 bricks; individually on a fixture: 14 ran (of which 10 constructed an object rather than computing a result; 14 with no instrument failure: 2 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 14 unverified. The assembly has not been run end-to-end.

one of 7 siblings

  1. muzero entry · level 0 · unverified · 8e9b0cff26418aa0
  2. MuZeroConfig helper · level 1 · ran · 3e343c7b7c4786ff
  3. ReplayBuffer data_transform · level 0 · unverified · 6ff1fe24a95ea773
  4. SharedStorage helper · level 1 · ran · 610fcab4b0c9cbd1
  5. launch_job helper · level 0 · unverified · c14a803ab75d12e0
  6. run_selfplay sampler · level 0 · unverified · 315c1446112d1012
  7. train_network update_rule · level 0 · unverified · abc403d4436aa68a
  8. Game helper · level 1 · ran · de896b106de5476f
  9. Network model · level 1 · ran · 5ca30608329df48f
  10. make_uniform_network helper · level 1 · ran · 00effc9a1425b666
  11. play_game sampler · level 0 · unverified · 57de20801e4ede5e
  12. update_weights update_rule · level 0 · unverified · 69a7fb6acc0e52bd
  13. Action helper · level 1 · ran · 6c89f46298706981
  14. ActionHistory helper · level 1 · ran · e8337fef1f2be2db
  15. Environment helper · level 1 · ran · ef2d84c53dd4b44c
  16. Node helper · level 1 · ran · f69c690385c860bb
  17. Player helper · level 1 · ran · 89236c13c0330206
  18. NetworkOutput helper · level 1 · ran · 298dd8d5ebffe115
  19. add_exploration_noise helper · level 0 · unverified · 75647f5246c855a9
  20. expand_node model · level 0 · unverified · 68325e020744ad6b
  21. run_mcts model · level 0 · unverified · cbc81cda9608e263
  22. select_action model · level 0 · unverified · fe46ed855a1faead
  23. scalar_loss loss · level 1 · ran · honoured contract · a6399bbbf15a6cf9
  24. MinMaxStats helper · level 1 · ran · 56fa35bdc3d1ed2d
  25. backpropagate model · level 0 · unverified · 66fa0db77edfb84f
  26. select_child model · level 0 · unverified · 683480d2bfbfe612
  27. softmax_sample helper · level 1 · ran · honoured contract · 5f8447d8f24a2352
  28. ucb_score model · level 0 · unverified · 5ab7b336cd84f817

harvested Assembly for MuZero (graph method: MuZero). 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 7 siblings

  1. MCTS entry · level 0 · unverified · 54758c22e1156b77
  2. MinMaxStats helper · level 1 · ran · be0ba3624e7c8b19

Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="1911.08265") returns these assemblies with each brick's role and wiring (how to connect).

Tasks

Atari GamesAtari Games 100kGame of ChessGame of GoGame of Shogi

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Atari Games Atari 2600 Alien MuZero Score 741812.63 #1 of 49 Archive leaderboard report
Atari Games Atari 2600 Amidar MuZero Score 28634.39 #3 of 48 Archive leaderboard report
Atari Games Atari 2600 Assault MuZero Score 143972.03 #1 of 45 Archive leaderboard report
Atari Games Atari 2600 Asterix MuZero Score 998425.00 #3 of 49 Archive leaderboard report
Atari Games Atari 2600 Asteroids MuZero Score 678558.64 #3 of 43 Archive leaderboard report
Atari Games Atari 2600 Atlantis MuZero Score 1674767.20 #5 of 42 Archive leaderboard report
Atari Games Atari 2600 Bank Heist MuZero Score 1278.98 #13 of 45 Archive leaderboard report
Atari Games Atari 2600 Battle Zone MuZero Score 848623.00 #2 of 47 Archive leaderboard report
Atari Games Atari 2600 Beam Rider MuZero Score 454993.53 #1 of 49 Archive leaderboard report
Atari Games Atari 2600 Berzerk MuZero Score 85932.60 #2 of 39 Archive leaderboard report
Atari Games Atari 2600 Bowling MuZero Score 260.13 #1 of 44 Archive leaderboard report
Atari Games Atari 2600 Boxing MuZero Score 100.00 #1 of 45 Archive leaderboard report
Atari Games Atari 2600 Centipede MuZero Score 1159049.27 #3 of 45 Archive leaderboard report
Atari Games Atari 2600 Chopper Command MuZero Score 991039.70 #5 of 45 Archive leaderboard report
Atari Games Atari 2600 Crazy Climber MuZero Score 458315.40 #2 of 49 Archive leaderboard report
Atari Games Atari 2600 Defender MuZero Score 839642.95 #5 of 21 Archive leaderboard report
Atari Games Atari 2600 Demon Attack MuZero Score 143964.26 #5 of 46 Archive leaderboard report
Atari Games Atari 2600 Double Dunk MuZero Score 23.94 #5 of 43 Archive leaderboard report
Atari Games Atari 2600 Enduro MuZero Score 2382.44 #5 of 48 Archive leaderboard report
Atari Games Atari 2600 Fishing Derby MuZero Score 91.16 #1 of 44 Archive leaderboard report
Atari Games Atari 2600 Freeway MuZero Score 33.03 #18 of 59 Archive leaderboard report
Atari Games Atari 2600 Frostbite MuZero Score 631378.53 #1 of 53 Archive leaderboard report
Atari Games Atari 2600 Gopher MuZero Score 130345.58 #3 of 43 Archive leaderboard report
Atari Games Atari 2600 Gravitar MuZero Score 6682.70 #6 of 53 Archive leaderboard report
Atari Games Atari 2600 HERO MuZero Score 49244.11 #2 of 44 Archive leaderboard report
Atari Games Atari 2600 Ice Hockey MuZero Score 67.04 #3 of 43 Archive leaderboard report
Atari Games Atari 2600 James Bond MuZero Score 41063.25 #6 of 45 Archive leaderboard report
Atari Games Atari 2600 Kangaroo MuZero Score 16763.60 #2 of 47 Archive leaderboard report
Atari Games Atari 2600 Krull MuZero Score 269358.27 #2 of 45 Archive leaderboard report
Atari Games Atari 2600 Kung-Fu Master MuZero Score 204824.00 #5 of 43 Archive leaderboard report
Atari Games Atari 2600 Montezuma's Revenge MuZero Score 0.00 #43 of 50 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman MuZero Score 243401.10 #1 of 47 Archive leaderboard report
Atari Games Atari 2600 Name This Game MuZero Score 157177.85 #1 of 43 Archive leaderboard report
Atari Games Atari 2600 Phoenix MuZero Score 955137.84 #2 of 21 Archive leaderboard report
Atari Games Atari 2600 Pitfall! MuZero Score 0.00 #5 of 23 Archive leaderboard report
Atari Games Atari 2600 Pong MuZero Score 21.00 #4 of 52 Archive leaderboard report
Atari Games Atari 2600 Private Eye MuZero Score 15299.98 #4 of 52 Archive leaderboard report
Atari Games Atari 2600 Q*Bert MuZero Score 72276.00 #9 of 57 Archive leaderboard report
Atari Games Atari 2600 River Raid MuZero Score 323417.18 #1 of 41 Archive leaderboard report
Atari Games Atari 2600 Road Runner MuZero Score 613411.80 #4 of 44 Archive leaderboard report
Atari Games Atari 2600 Robotank MuZero Score 131.13 #1 of 42 Archive leaderboard report
Atari Games Atari 2600 Seaquest MuZero Score 999976.52 #5 of 57 Archive leaderboard report
Atari Games Atari 2600 Skiing MuZero Score -29968.36 #4 of 23 Archive leaderboard report
Atari Games Atari 2600 Solaris MuZero Score 56.62 #23 of 23 Archive leaderboard report
Atari Games Atari 2600 Space Invaders MuZero Score 74335.30 #5 of 55 Archive leaderboard report
Atari Games Atari 2600 Star Gunner MuZero Score 549271.70 #4 of 43 Archive leaderboard report
Atari Games Atari 2600 Surround MuZero Score 9.99 #2 of 15 Archive leaderboard report
Atari Games Atari 2600 Tennis MuZero Score 0.00 #24 of 43 Archive leaderboard report
Atari Games Atari 2600 Time Pilot MuZero Score 476763.90 #1 of 44 Archive leaderboard report
Atari Games Atari 2600 Tutankham MuZero Score 491.48 #2 of 44 Archive leaderboard report
Atari Games Atari 2600 Up and Down MuZero Score 715545.61 #4 of 44 Archive leaderboard report
Atari Games Atari 2600 Venture MuZero Score 0.40 #48 of 55 Archive leaderboard report
Atari Games Atari 2600 Video Pinball MuZero Score 981791.88 #3 of 42 Archive leaderboard report
Atari Games Atari 2600 Wizard of Wor MuZero Score 197126.00 #1 of 41 Archive leaderboard report
Atari Games Atari 2600 Yars Revenge MuZero Score 553311.46 #6 of 17 Archive leaderboard report
Atari Games Atari 2600 Zaxxon MuZero Score 725853.90 #1 of 41 Archive leaderboard report
Atari Games Atari games MuZero Mean Human Normalized Score 4996.20% #3 of 12 Archive leaderboard report
Atari Games Atari-57 MuZero Human World Record Breakthrough 19 #5 of 11 Archive leaderboard report
Atari Games Atari-57 MuZero Mean Human Normalized Score 4996.20% #5 of 11 Archive leaderboard report
Atari Games atari game Muzero Human World Record Breakthrough 19 #2 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: MuZero

AlphaZeroAverage PoolingBatch NormalizationConvolutionMonte-Carlo Tree SearchMuZeroPrioritized Experience ReplayReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections