{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/godot-reinforcement-learning-agents","title":"Godot Reinforcement Learning Agents","arxiv_id":"2112.03636","date":"2021-12-07","proceeding":null,"authors":["Edward Beeching","Jilles Debangoye","Olivier Simonin","Christian Wolf"],"abstract":"We present Godot Reinforcement Learning (RL) Agents, an open-source interface for developing environments and agents in the Godot Game Engine. The Godot RL Agents interface allows the design, creation and learning of agent behaviors in challenging 2D and 3D environments with various on-policy and off-policy Deep RL algorithms. We provide a standard Gym interface, with wrappers for learning in the Ray RLlib and Stable Baselines RL frameworks. This allows users access to over 20 state of the art on-policy, off-policy and multi-agent RL algorithms. The framework is a versatile tool that allows researchers and game designers the ability to create environments with discrete, continuous and mixed action spaces. The interface is relatively performant, with 12k interactions per second on a high end laptop computer, when parallized on 4 CPU cores. An overview video is available here: https://youtu.be/g1MlZSFqIj4","url_abs":"https://arxiv.org/abs/2112.03636v1","url_pdf":"https://arxiv.org/pdf/2112.03636v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"godot-reinforcement-learning-agents","repo_url":"https://github.com/edbeeching/godot_rl_agents","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":null,"task_name":"CPU"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"},{"task_slug":"rllib","task_name":"rllib"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2112.03636","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2112.03636"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/edbeeching/godot_rl_agents","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"4cee71b4d9b5a737","entry":"linear_schedule","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"4cee71b4d9b5a737"}},{"code_sha256_prefix":"f06a7f1b66ad1f58","entry":"convert_macos_path","repo":"edbeeching/godot_rl_agents","repo_kind":"official","path":"godot_rl/core/utils.py","file_url":"https://github.com/edbeeching/godot_rl_agents/blob/HEAD/godot_rl/core/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f06a7f1b66ad1f58"}},{"code_sha256_prefix":"aa1cc1a4879f13c9","entry":"dol_to_lod","repo":"edbeeching/godot_rl_agents","repo_kind":"official","path":"godot_rl/core/utils.py","file_url":"https://github.com/edbeeching/godot_rl_agents/blob/HEAD/godot_rl/core/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa1cc1a4879f13c9"}},{"code_sha256_prefix":"bb264e4aa34d09b5","entry":"env","repo":"edbeeching/godot_rl_agents","repo_kind":"official","path":"godot_rl/wrappers/petting_zoo_wrapper.py","file_url":"https://github.com/edbeeching/godot_rl_agents/blob/HEAD/godot_rl/wrappers/petting_zoo_wrapper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bb264e4aa34d09b5"}},{"code_sha256_prefix":"c29768ee9fd11ea0","entry":"lod_to_dol","repo":"edbeeching/godot_rl_agents","repo_kind":"official","path":"godot_rl/core/utils.py","file_url":"https://github.com/edbeeching/godot_rl_agents/blob/HEAD/godot_rl/core/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c29768ee9fd11ea0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}