{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/smarts-scalable-multi-agent-reinforcement","title":"SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Driving","arxiv_id":"2010.09776","date":"2020-10-19","proceeding":null,"authors":["Ming Zhou","Jun Luo","Julian Villella","Yaodong Yang","David Rusu","Jiayu Miao","Weinan Zhang","Montgomery Alban","Iman Fadakar","Zheng Chen","Aurora Chongxi Huang","Ying Wen","Kimia Hassanzadeh","Daniel Graves","Dong Chen","Zhengbang Zhu","Nhat Nguyen","Mohamed Elsayed","Kun Shao","Sanjeevan Ahilan","Baokuan Zhang","Jiannan Wu","Zhengang Fu","Kasra Rezaee","Peyman Yadmellat","Mohsen Rohani","Nicolas Perez Nieves","Yihan Ni","Seyedershad Banijamali","Alexander Cowen Rivers","Zheng Tian","Daniel Palenicek","Haitham Bou Ammar","Hongbo Zhang","Wulong Liu","Jianye Hao","Jun Wang"],"abstract":"Multi-agent interaction is a fundamental aspect of autonomous driving in the real world. Despite more than a decade of research and development, the problem of how to competently interact with diverse road users in diverse scenarios remains largely unsolved. Learning methods have much to offer towards solving this problem. But they require a realistic multi-agent simulator that generates diverse and competent driving interactions. To meet this need, we develop a dedicated simulation platform called SMARTS (Scalable Multi-Agent RL Training School). SMARTS supports the training, accumulation, and use of diverse behavior models of road users. These are in turn used to create increasingly more realistic and diverse interactions that enable deeper and broader research on multi-agent interaction. In this paper, we describe the design goals of SMARTS, explain its basic architecture and its key features, and illustrate its use through concrete multi-agent experiments on interactive scenarios. We open-source the SMARTS platform and the associated benchmark tasks and evaluation metrics to encourage and empower research on multi-agent learning for autonomous driving. Our code is available at https://github.com/huawei-noah/SMARTS.","url_abs":"https://arxiv.org/abs/2010.09776v2","url_pdf":"https://arxiv.org/pdf/2010.09776v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"smarts-scalable-multi-agent-reinforcement","repo_url":"https://github.com/huawei-noah/SMARTS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"smarts-scalable-multi-agent-reinforcement","repo_url":"https://github.com/Dikshuy/SMARTS-lite","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"smarts-scalable-multi-agent-reinforcement","repo_url":"https://github.com/Duckkkky/smarts","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"smarts-scalable-multi-agent-reinforcement","repo_url":"https://github.com/mcederle99/MAD4QN-PS","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"smarts-scalable-multi-agent-reinforcement","repo_url":"https://github.com/yuant95/SMARTS_VCR","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"multi-agent-reinforcement-learning","task_name":"Multi-agent Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2010.09776","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.09776"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mcederle99/MAD4QN-PS","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yuant95/SMARTS_VCR","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Duckkkky/smarts","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Dikshuy/SMARTS-lite","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/huawei-noah/SMARTS","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":5},"by_repo_kind":{"listed":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"de4e237f932aca7e","entry":"build_policy","repo":"mcederle99/MAD4QN-PS","repo_kind":"listed","path":"cli/zoo.py","file_url":"https://github.com/mcederle99/MAD4QN-PS/blob/HEAD/cli/zoo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"de4e237f932aca7e"}},{"code_sha256_prefix":"99c73d29a74932a2","entry":"eval_policy","repo":"mcederle99/MAD4QN-PS","repo_kind":"listed","path":"util_rgb.py","file_url":"https://github.com/mcederle99/MAD4QN-PS/blob/HEAD/util_rgb.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"99c73d29a74932a2"}},{"code_sha256_prefix":"13add24a2c857faa","entry":"list_benchmarks","repo":"mcederle99/MAD4QN-PS","repo_kind":"listed","path":"cli/benchmark.py","file_url":"https://github.com/mcederle99/MAD4QN-PS/blob/HEAD/cli/benchmark.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"13add24a2c857faa"}},{"code_sha256_prefix":"4e65a552c24a864d","entry":"make_env","repo":"mcederle99/MAD4QN-PS","repo_kind":"listed","path":"util_rgb.py","file_url":"https://github.com/mcederle99/MAD4QN-PS/blob/HEAD/util_rgb.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"4e65a552c24a864d"}},{"code_sha256_prefix":"fb489e9ae964aa7f","entry":"position2road","repo":"mcederle99/MAD4QN-PS","repo_kind":"listed","path":"util_rgb.py","file_url":"https://github.com/mcederle99/MAD4QN-PS/blob/HEAD/util_rgb.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"fb489e9ae964aa7f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}