{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mastering-atari-go-chess-and-shogi-by","title":"Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model","arxiv_id":"1911.08265","date":"2019-11-19","proceeding":null,"authors":["Julian Schrittwieser","Ioannis Antonoglou","Thomas Hubert","Karen Simonyan","Laurent SIfre","Simon Schmitt","Arthur Guez","Edward Lockhart","Demis Hassabis","Thore Graepel","Timothy Lillicrap","David Silver"],"abstract":"Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods have enjoyed huge success in challenging domains, such as chess and Go, where a perfect simulator is available. However, in real-world problems the dynamics governing the environment are often complex and unknown. In this work we present the MuZero algorithm which, by combining a tree-based search with a learned model, achieves superhuman performance in a range of challenging and visually complex domains, without any knowledge of their underlying dynamics. MuZero learns a model that, when applied iteratively, predicts the quantities most directly relevant to planning: the reward, the action-selection policy, and the value function. When evaluated on 57 different Atari games - the canonical video game environment for testing AI techniques, in which model-based planning approaches have historically struggled - our new algorithm achieved a new state of the art. When evaluated on Go, chess and shogi, without any knowledge of the game rules, MuZero matched the superhuman performance of the AlphaZero algorithm that was supplied with the game rules.","url_abs":"https://arxiv.org/abs/1911.08265v2","url_pdf":"https://arxiv.org/pdf/1911.08265v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/DHDev0/Muzero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/JuanCCS/muzero-jc","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/Miatto-research-group/muzero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/SHRIVP/muzero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/YuriCat/MuZeroJupyterExample","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/Zeta36/muzero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/ZiyuanMa/reversi","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/colindbrown/columbia-deep-learning-project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/dmiracle/muzero-starter","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/foersterrobert/MuZero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/johan-gras/MuZero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/k-lombard/CS4641_Project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/k-lombard/Deep-Learning-Chess-AI","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/kaesve/muzero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/koulanurag/muzero-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/opendilab/LightZero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/snjstudent/MyMuzero","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"mastering-atari-go-chess-and-shogi-by","repo_url":"https://github.com/werner-duvaud/muzero-general","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"atari-games","task_name":"Atari Games"},{"task_slug":"atari-games-100k","task_name":"Atari Games 100k"},{"task_slug":"game-of-chess","task_name":"Game of Chess"},{"task_slug":"game-of-go","task_name":"Game of Go"},{"task_slug":"game-of-shogi","task_name":"Game of Shogi"}],"methods":[{"method_slug":"alphazero","method_name":"AlphaZero"},{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"monte-carlo-tree-search","method_name":"Monte-Carlo Tree Search"},{"method_slug":"muzero","method_name":"MuZero"},{"method_slug":"prioritized-experience-replay","method_name":"Prioritized Experience Replay"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-block","method_name":"Residual Block"},{"method_slug":"residual-connection","method_name":"Residual Connection"}],"datasets_introduced":[],"methods_introduced":[{"slug":"muzero","name":"MuZero","full_name":"MuZero"}],"results":[{"leaderboard":"/sota/atari-games-on-atari-2600-alien","task":"Atari Games","dataset":"Atari 2600 Alien","model":"MuZero","rank_in_archive_order":1,"of":49,"metrics":{"Score":"741812.63"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-amidar","task":"Atari Games","dataset":"Atari 2600 Amidar","model":"MuZero","rank_in_archive_order":3,"of":48,"metrics":{"Score":"28634.39"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-assault","task":"Atari Games","dataset":"Atari 2600 Assault","model":"MuZero","rank_in_archive_order":1,"of":45,"metrics":{"Score":"143972.03"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-asterix","task":"Atari Games","dataset":"Atari 2600 Asterix","model":"MuZero","rank_in_archive_order":3,"of":49,"metrics":{"Score":"998425.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-asteroids","task":"Atari Games","dataset":"Atari 2600 Asteroids","model":"MuZero","rank_in_archive_order":3,"of":43,"metrics":{"Score":"678558.64"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-atlantis","task":"Atari Games","dataset":"Atari 2600 Atlantis","model":"MuZero","rank_in_archive_order":5,"of":42,"metrics":{"Score":"1674767.20"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-bank-heist","task":"Atari Games","dataset":"Atari 2600 Bank Heist","model":"MuZero","rank_in_archive_order":13,"of":45,"metrics":{"Score":"1278.98"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-battle-zone","task":"Atari Games","dataset":"Atari 2600 Battle Zone","model":"MuZero","rank_in_archive_order":2,"of":47,"metrics":{"Score":"848623.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-beam-rider","task":"Atari Games","dataset":"Atari 2600 Beam Rider","model":"MuZero","rank_in_archive_order":1,"of":49,"metrics":{"Score":"454993.53"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-berzerk","task":"Atari Games","dataset":"Atari 2600 Berzerk","model":"MuZero","rank_in_archive_order":2,"of":39,"metrics":{"Score":"85932.60"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-bowling","task":"Atari Games","dataset":"Atari 2600 Bowling","model":"MuZero","rank_in_archive_order":1,"of":44,"metrics":{"Score":"260.13"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-boxing","task":"Atari Games","dataset":"Atari 2600 Boxing","model":"MuZero","rank_in_archive_order":1,"of":45,"metrics":{"Score":"100.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-centipede","task":"Atari Games","dataset":"Atari 2600 Centipede","model":"MuZero","rank_in_archive_order":3,"of":45,"metrics":{"Score":"1159049.27"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-chopper-command","task":"Atari Games","dataset":"Atari 2600 Chopper Command","model":"MuZero","rank_in_archive_order":5,"of":45,"metrics":{"Score":"991039.70"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-crazy-climber","task":"Atari Games","dataset":"Atari 2600 Crazy Climber","model":"MuZero","rank_in_archive_order":2,"of":49,"metrics":{"Score":"458315.40"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-defender","task":"Atari Games","dataset":"Atari 2600 Defender","model":"MuZero","rank_in_archive_order":5,"of":21,"metrics":{"Score":"839642.95"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-demon-attack","task":"Atari Games","dataset":"Atari 2600 Demon Attack","model":"MuZero","rank_in_archive_order":5,"of":46,"metrics":{"Score":"143964.26"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-double-dunk","task":"Atari Games","dataset":"Atari 2600 Double Dunk","model":"MuZero","rank_in_archive_order":5,"of":43,"metrics":{"Score":"23.94"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-enduro","task":"Atari Games","dataset":"Atari 2600 Enduro","model":"MuZero","rank_in_archive_order":5,"of":48,"metrics":{"Score":"2382.44"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-fishing-derby","task":"Atari Games","dataset":"Atari 2600 Fishing Derby","model":"MuZero","rank_in_archive_order":1,"of":44,"metrics":{"Score":"91.16"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-freeway","task":"Atari Games","dataset":"Atari 2600 Freeway","model":"MuZero","rank_in_archive_order":18,"of":59,"metrics":{"Score":"33.03"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-frostbite","task":"Atari Games","dataset":"Atari 2600 Frostbite","model":"MuZero","rank_in_archive_order":1,"of":53,"metrics":{"Score":"631378.53"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-gopher","task":"Atari Games","dataset":"Atari 2600 Gopher","model":"MuZero","rank_in_archive_order":3,"of":43,"metrics":{"Score":"130345.58"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-gravitar","task":"Atari Games","dataset":"Atari 2600 Gravitar","model":"MuZero","rank_in_archive_order":6,"of":53,"metrics":{"Score":"6682.70"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-hero","task":"Atari Games","dataset":"Atari 2600 HERO","model":"MuZero","rank_in_archive_order":2,"of":44,"metrics":{"Score":"49244.11"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-ice-hockey","task":"Atari Games","dataset":"Atari 2600 Ice Hockey","model":"MuZero","rank_in_archive_order":3,"of":43,"metrics":{"Score":"67.04"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-james-bond","task":"Atari Games","dataset":"Atari 2600 James Bond","model":"MuZero","rank_in_archive_order":6,"of":45,"metrics":{"Score":"41063.25"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-kangaroo","task":"Atari Games","dataset":"Atari 2600 Kangaroo","model":"MuZero","rank_in_archive_order":2,"of":47,"metrics":{"Score":"16763.60"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-krull","task":"Atari Games","dataset":"Atari 2600 Krull","model":"MuZero","rank_in_archive_order":2,"of":45,"metrics":{"Score":"269358.27"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-kung-fu-master","task":"Atari Games","dataset":"Atari 2600 Kung-Fu Master","model":"MuZero","rank_in_archive_order":5,"of":43,"metrics":{"Score":"204824.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-montezumas-revenge","task":"Atari Games","dataset":"Atari 2600 Montezuma's Revenge","model":"MuZero","rank_in_archive_order":43,"of":50,"metrics":{"Score":"0.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-ms-pacman","task":"Atari Games","dataset":"Atari 2600 Ms. Pacman","model":"MuZero","rank_in_archive_order":1,"of":47,"metrics":{"Score":"243401.10"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-name-this-game","task":"Atari Games","dataset":"Atari 2600 Name This Game","model":"MuZero","rank_in_archive_order":1,"of":43,"metrics":{"Score":"157177.85"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-phoenix","task":"Atari Games","dataset":"Atari 2600 Phoenix","model":"MuZero","rank_in_archive_order":2,"of":21,"metrics":{"Score":"955137.84"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-pitfall","task":"Atari Games","dataset":"Atari 2600 Pitfall!","model":"MuZero","rank_in_archive_order":5,"of":23,"metrics":{"Score":"0.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-pong","task":"Atari Games","dataset":"Atari 2600 Pong","model":"MuZero","rank_in_archive_order":4,"of":52,"metrics":{"Score":"21.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-private-eye","task":"Atari Games","dataset":"Atari 2600 Private Eye","model":"MuZero","rank_in_archive_order":4,"of":52,"metrics":{"Score":"15299.98"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-qbert","task":"Atari Games","dataset":"Atari 2600 Q*Bert","model":"MuZero","rank_in_archive_order":9,"of":57,"metrics":{"Score":"72276.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-river-raid","task":"Atari Games","dataset":"Atari 2600 River Raid","model":"MuZero","rank_in_archive_order":1,"of":41,"metrics":{"Score":"323417.18"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-road-runner","task":"Atari Games","dataset":"Atari 2600 Road Runner","model":"MuZero","rank_in_archive_order":4,"of":44,"metrics":{"Score":"613411.80"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-robotank","task":"Atari Games","dataset":"Atari 2600 Robotank","model":"MuZero","rank_in_archive_order":1,"of":42,"metrics":{"Score":"131.13"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-seaquest","task":"Atari Games","dataset":"Atari 2600 Seaquest","model":"MuZero","rank_in_archive_order":5,"of":57,"metrics":{"Score":"999976.52"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-skiing","task":"Atari Games","dataset":"Atari 2600 Skiing","model":"MuZero","rank_in_archive_order":4,"of":23,"metrics":{"Score":"-29968.36"},"uses_additional_data":true},{"leaderboard":"/sota/atari-games-on-atari-2600-solaris","task":"Atari Games","dataset":"Atari 2600 Solaris","model":"MuZero","rank_in_archive_order":23,"of":23,"metrics":{"Score":"56.62"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-space-invaders","task":"Atari Games","dataset":"Atari 2600 Space Invaders","model":"MuZero","rank_in_archive_order":5,"of":55,"metrics":{"Score":"74335.30"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-star-gunner","task":"Atari Games","dataset":"Atari 2600 Star Gunner","model":"MuZero","rank_in_archive_order":4,"of":43,"metrics":{"Score":"549271.70"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-surround","task":"Atari Games","dataset":"Atari 2600 Surround","model":"MuZero","rank_in_archive_order":2,"of":15,"metrics":{"Score":"9.99"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-tennis","task":"Atari Games","dataset":"Atari 2600 Tennis","model":"MuZero","rank_in_archive_order":24,"of":43,"metrics":{"Score":"0.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-time-pilot","task":"Atari Games","dataset":"Atari 2600 Time Pilot","model":"MuZero","rank_in_archive_order":1,"of":44,"metrics":{"Score":"476763.90"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-tutankham","task":"Atari Games","dataset":"Atari 2600 Tutankham","model":"MuZero","rank_in_archive_order":2,"of":44,"metrics":{"Score":"491.48"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-up-and-down","task":"Atari Games","dataset":"Atari 2600 Up and Down","model":"MuZero","rank_in_archive_order":4,"of":44,"metrics":{"Score":"715545.61"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-venture","task":"Atari Games","dataset":"Atari 2600 Venture","model":"MuZero","rank_in_archive_order":48,"of":55,"metrics":{"Score":"0.40"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-video-pinball","task":"Atari Games","dataset":"Atari 2600 Video Pinball","model":"MuZero","rank_in_archive_order":3,"of":42,"metrics":{"Score":"981791.88"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-wizard-of-wor","task":"Atari Games","dataset":"Atari 2600 Wizard of Wor","model":"MuZero","rank_in_archive_order":1,"of":41,"metrics":{"Score":"197126.00"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-yars-revenge","task":"Atari Games","dataset":"Atari 2600 Yars Revenge","model":"MuZero","rank_in_archive_order":6,"of":17,"metrics":{"Score":"553311.46"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-2600-zaxxon","task":"Atari Games","dataset":"Atari 2600 Zaxxon","model":"MuZero","rank_in_archive_order":1,"of":41,"metrics":{"Score":"725853.90"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-games","task":"Atari Games","dataset":"Atari games","model":"MuZero","rank_in_archive_order":3,"of":12,"metrics":{"Mean Human Normalized Score":"4996.20%"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-57","task":"Atari Games","dataset":"Atari-57","model":"MuZero","rank_in_archive_order":5,"of":11,"metrics":{"Human World Record Breakthrough":"19","Mean Human Normalized Score":"4996.20%"},"uses_additional_data":false},{"leaderboard":"/sota/atari-games-on-atari-game","task":"Atari Games","dataset":"atari game","model":"Muzero","rank_in_archive_order":2,"of":9,"metrics":{"Human World Record Breakthrough":"19"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1911.08265","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.08265"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/opendilab/LightZero","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/k-lombard/CS4641_Project","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SHRIVP/muzero","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dmiracle/muzero-starter","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/DHDev0/Muzero","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/colindbrown/columbia-deep-learning-project","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/k-lombard/Deep-Learning-Chess-AI","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Miatto-research-group/muzero","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/werner-duvaud/muzero-general","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/johan-gras/MuZero","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ZiyuanMa/reversi","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/JuanCCS/muzero-jc","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Zeta36/muzero","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/foersterrobert/MuZero","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kaesve/muzero","reach":{"status":"unanswered"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/YuriCat/MuZeroJupyterExample","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/snjstudent/MyMuzero","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/koulanurag/muzero-pytorch","reach":null}],"summary":{"ran":39,"ran_honours":4,"unverified":21},"by_repo_kind":{"listed":{"samples":64,"ran":43,"repositories":7}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":62,"samples":[{"code_sha256_prefix":"a2a9ed20152a3952","entry":"Action","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"a2a9ed20152a3952"}},{"code_sha256_prefix":"6c89f46298706981","entry":"Action","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6c89f46298706981"}},{"code_sha256_prefix":"e8337fef1f2be2db","entry":"ActionHistory","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e8337fef1f2be2db"}},{"code_sha256_prefix":"54a71cf4bd44cdb5","entry":"Conv","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"54a71cf4bd44cdb5"}},{"code_sha256_prefix":"e54e936724993d90","entry":"DiscreteSupport","repo":"foersterrobert/MuZero","repo_kind":"listed","path":"Environments/CarRacing/model.py","file_url":"https://github.com/foersterrobert/MuZero/blob/HEAD/Environments/CarRacing/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e54e936724993d90"}},{"code_sha256_prefix":"cdddcdc3c7ca7abd","entry":"Dynamics","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"cdddcdc3c7ca7abd"}},{"code_sha256_prefix":"30d4d7d24de54388","entry":"Dynamics","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"30d4d7d24de54388"}},{"code_sha256_prefix":"cbc3bb0d9250d6be","entry":"DynamicsFunction","repo":"foersterrobert/MuZero","repo_kind":"listed","path":"Environments/CarRacing/model.py","file_url":"https://github.com/foersterrobert/MuZero/blob/HEAD/Environments/CarRacing/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cbc3bb0d9250d6be"}},{"code_sha256_prefix":"f350ba73bb2b6c49","entry":"Dynamics_function","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"f350ba73bb2b6c49"}},{"code_sha256_prefix":"ef2d84c53dd4b44c","entry":"Environment","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ef2d84c53dd4b44c"}},{"code_sha256_prefix":"af3e096bbf7db489","entry":"Episode","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"af3e096bbf7db489"}},{"code_sha256_prefix":"de896b106de5476f","entry":"Game","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"de896b106de5476f"}},{"code_sha256_prefix":"2163d21945e117d2","entry":"Gym_space_transform","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"2163d21945e117d2"}},{"code_sha256_prefix":"3c443470e4e1a53e","entry":"Loss_function","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"3c443470e4e1a53e"}},{"code_sha256_prefix":"8fda00742ff79300","entry":"MDP","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8fda00742ff79300"}},{"code_sha256_prefix":"56fa35bdc3d1ed2d","entry":"MinMaxStats","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"56fa35bdc3d1ed2d"}},{"code_sha256_prefix":"be0ba3624e7c8b19","entry":"MinMaxStats","repo":"koulanurag/muzero-pytorch","repo_kind":"listed","path":"core/mcts.py","file_url":"https://github.com/koulanurag/muzero-pytorch/blob/HEAD/core/mcts.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be0ba3624e7c8b19"}},{"code_sha256_prefix":"3e343c7b7c4786ff","entry":"MuZeroConfig","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3e343c7b7c4786ff"}},{"code_sha256_prefix":"b325291e54b512ea","entry":"Network","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b325291e54b512ea"}},{"code_sha256_prefix":"350296e8e546c436","entry":"Network","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"350296e8e546c436"}},{"code_sha256_prefix":"5ca30608329df48f","entry":"Network","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5ca30608329df48f"}},{"code_sha256_prefix":"c00d34318df332ef","entry":"NetworkOutput","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"c00d34318df332ef"}},{"code_sha256_prefix":"298dd8d5ebffe115","entry":"NetworkOutput","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"298dd8d5ebffe115"}},{"code_sha256_prefix":"5c75c7c9c180b73f","entry":"Node","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5c75c7c9c180b73f"}},{"code_sha256_prefix":"f69c690385c860bb","entry":"Node","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f69c690385c860bb"}},{"code_sha256_prefix":"89236c13c0330206","entry":"Player","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89236c13c0330206"}},{"code_sha256_prefix":"a545ea9c6da33b3b","entry":"Prediction","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"a545ea9c6da33b3b"}},{"code_sha256_prefix":"22e39aaf897c5ae2","entry":"Prediction","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"22e39aaf897c5ae2"}},{"code_sha256_prefix":"c2e1dd48bfa01608","entry":"PredictionFunction","repo":"foersterrobert/MuZero","repo_kind":"listed","path":"Environments/CarRacing/model.py","file_url":"https://github.com/foersterrobert/MuZero/blob/HEAD/Environments/CarRacing/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c2e1dd48bfa01608"}},{"code_sha256_prefix":"f494f13eb22d701c","entry":"Prediction_function","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"f494f13eb22d701c"}},{"code_sha256_prefix":"7c65617a096f3525","entry":"Representation","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"7c65617a096f3525"}},{"code_sha256_prefix":"31b7161c4ce14024","entry":"Representation","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"31b7161c4ce14024"}},{"code_sha256_prefix":"4af5cddce927144e","entry":"RepresentationFunction","repo":"foersterrobert/MuZero","repo_kind":"listed","path":"Environments/CarRacing/model.py","file_url":"https://github.com/foersterrobert/MuZero/blob/HEAD/Environments/CarRacing/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4af5cddce927144e"}},{"code_sha256_prefix":"a6b5b641f84a85a8","entry":"Representation_function","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"a6b5b641f84a85a8"}},{"code_sha256_prefix":"4cac665725b2396a","entry":"ResBlock","repo":"foersterrobert/MuZero","repo_kind":"listed","path":"Environments/CarRacing/model.py","file_url":"https://github.com/foersterrobert/MuZero/blob/HEAD/Environments/CarRacing/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4cac665725b2396a"}},{"code_sha256_prefix":"697fbe33b6749d85","entry":"ResidualBlock","repo":"Zeta36/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Zeta36/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"697fbe33b6749d85"}},{"code_sha256_prefix":"9870e1b665456b71","entry":"Residual_Block","repo":"snjstudent/MyMuzero","repo_kind":"listed","path":"model_muzero.py","file_url":"https://github.com/snjstudent/MyMuzero/blob/HEAD/model_muzero.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9870e1b665456b71"}},{"code_sha256_prefix":"610fcab4b0c9cbd1","entry":"SharedStorage","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"610fcab4b0c9cbd1"}},{"code_sha256_prefix":"130559f2af719d4c","entry":"l2","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"130559f2af719d4c"}},{"code_sha256_prefix":"00effc9a1425b666","entry":"make_uniform_network","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"00effc9a1425b666"}},{"code_sha256_prefix":"a6399bbbf15a6cf9","entry":"scalar_loss","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a6399bbbf15a6cf9"}},{"code_sha256_prefix":"b8f46926e70c3faf","entry":"scale_to_bound_action","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b8f46926e70c3faf"}},{"code_sha256_prefix":"5f8447d8f24a2352","entry":"softmax_sample","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5f8447d8f24a2352"}},{"code_sha256_prefix":"13c74e7e84599c32","entry":"Game","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"13c74e7e84599c32"}},{"code_sha256_prefix":"54758c22e1156b77","entry":"MCTS","repo":"koulanurag/muzero-pytorch","repo_kind":"listed","path":"core/mcts.py","file_url":"https://github.com/koulanurag/muzero-pytorch/blob/HEAD/core/mcts.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"54758c22e1156b77"}},{"code_sha256_prefix":"ebb3d8aed0e0cff6","entry":"MuZero","repo":"foersterrobert/MuZero","repo_kind":"listed","path":"Environments/CarRacing/model.py","file_url":"https://github.com/foersterrobert/MuZero/blob/HEAD/Environments/CarRacing/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ebb3d8aed0e0cff6"}},{"code_sha256_prefix":"abfe4355cbd8718d","entry":"MuZero_Model","repo":"snjstudent/MyMuzero","repo_kind":"listed","path":"model_muzero.py","file_url":"https://github.com/snjstudent/MyMuzero/blob/HEAD/model_muzero.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"abfe4355cbd8718d"}},{"code_sha256_prefix":"af8bd591fad76cfd","entry":"Muzero","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"af8bd591fad76cfd"}},{"code_sha256_prefix":"cc8d0217186545a5","entry":"Muzero","repo":"Miatto-research-group/muzero","repo_kind":"listed","path":"muzero.py","file_url":"https://github.com/Miatto-research-group/muzero/blob/HEAD/muzero.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cc8d0217186545a5"}},{"code_sha256_prefix":"6ff1fe24a95ea773","entry":"ReplayBuffer","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6ff1fe24a95ea773"}},{"code_sha256_prefix":"75647f5246c855a9","entry":"add_exploration_noise","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"75647f5246c855a9"}},{"code_sha256_prefix":"66fa0db77edfb84f","entry":"backpropagate","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"66fa0db77edfb84f"}},{"code_sha256_prefix":"68325e020744ad6b","entry":"expand_node","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"68325e020744ad6b"}},{"code_sha256_prefix":"c14a803ab75d12e0","entry":"launch_job","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c14a803ab75d12e0"}},{"code_sha256_prefix":"8e9b0cff26418aa0","entry":"muzero","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8e9b0cff26418aa0"}},{"code_sha256_prefix":"57de20801e4ede5e","entry":"play_game","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"57de20801e4ede5e"}},{"code_sha256_prefix":"cbc81cda9608e263","entry":"run_mcts","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cbc81cda9608e263"}},{"code_sha256_prefix":"315c1446112d1012","entry":"run_selfplay","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"315c1446112d1012"}},{"code_sha256_prefix":"fe46ed855a1faead","entry":"select_action","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fe46ed855a1faead"}},{"code_sha256_prefix":"683480d2bfbfe612","entry":"select_child","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"683480d2bfbfe612"}},{"code_sha256_prefix":"abc403d4436aa68a","entry":"train_network","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"abc403d4436aa68a"}},{"code_sha256_prefix":"5ab7b336cd84f817","entry":"ucb_score","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5ab7b336cd84f817"}},{"code_sha256_prefix":"69a7fb6acc0e52bd","entry":"update_weights","repo":"dmiracle/muzero-starter","repo_kind":"listed","path":"pseudocode.py","file_url":"https://github.com/dmiracle/muzero-starter/blob/HEAD/pseudocode.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"69a7fb6acc0e52bd"}},{"code_sha256_prefix":"4a1372219a8f271f","entry":"weights_init","repo":"DHDev0/Muzero","repo_kind":"listed","path":"muzero_model.py","file_url":"https://github.com/DHDev0/Muzero/blob/HEAD/muzero_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"4a1372219a8f271f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}