{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-minerl-competition-on-sample-efficient-1","title":"Retrospective Analysis of the 2019 MineRL Competition on Sample Efficient Reinforcement Learning","arxiv_id":"2003.05012","date":"2020-03-10","proceeding":null,"authors":["Stephanie Milani","Nicholay Topin","Brandon Houghton","William H. Guss","Sharada P. Mohanty","Keisuke Nakata","Oriol Vinyals","Noboru Sean Kuno"],"abstract":"To facilitate research in the direction of sample efficient reinforcement learning, we held the MineRL Competition on Sample Efficient Reinforcement Learning Using Human Priors at the Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019). The primary goal of this competition was to promote the development of algorithms that use human demonstrations alongside reinforcement learning to reduce the number of samples needed to solve complex, hierarchical, and sparse environments. We describe the competition, outlining the primary challenge, the competition design, and the resources that we provided to the participants. We provide an overview of the top solutions, each of which use deep reinforcement learning and/or imitation learning. We also discuss the impact of our organizational decisions on the competition and future directions for improvement.","url_abs":"https://arxiv.org/abs/2003.05012v4","url_pdf":"https://arxiv.org/pdf/2003.05012v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"imitation-learning","task_name":"Imitation Learning"},{"task_slug":"reinforcement-learning","task_name":"Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2003.05012","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2003.05012"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/AIcrowd/repo2docker","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"unverified":7},"by_repo_kind":{"found_in_text":{"samples":7,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"736b82dc59e7f8f2","entry":"execute_cmd","repo":"AIcrowd/repo2docker","repo_kind":"found_in_text","path":"repo2docker/utils.py","file_url":"https://github.com/AIcrowd/repo2docker/blob/HEAD/repo2docker/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"736b82dc59e7f8f2"}},{"code_sha256_prefix":"757792033d636031","entry":"is_valid_docker_image_name","repo":"AIcrowd/repo2docker","repo_kind":"found_in_text","path":"repo2docker/utils.py","file_url":"https://github.com/AIcrowd/repo2docker/blob/HEAD/repo2docker/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"757792033d636031"}},{"code_sha256_prefix":"f12f4dabbeb242eb","entry":"register_vcs_handler","repo":"AIcrowd/repo2docker","repo_kind":"found_in_text","path":"repo2docker/_version.py","file_url":"https://github.com/AIcrowd/repo2docker/blob/HEAD/repo2docker/_version.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"f12f4dabbeb242eb"}},{"code_sha256_prefix":"86d4ff45d6295e29","entry":"run_command","repo":"AIcrowd/repo2docker","repo_kind":"found_in_text","path":"repo2docker/_version.py","file_url":"https://github.com/AIcrowd/repo2docker/blob/HEAD/repo2docker/_version.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"86d4ff45d6295e29"}},{"code_sha256_prefix":"48795f5e84368c01","entry":"validate_and_generate_port_mapping","repo":"AIcrowd/repo2docker","repo_kind":"found_in_text","path":"repo2docker/utils.py","file_url":"https://github.com/AIcrowd/repo2docker/blob/HEAD/repo2docker/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"48795f5e84368c01"}},{"code_sha256_prefix":"6481b74df8d09f73","entry":"validate_image_name","repo":"AIcrowd/repo2docker","repo_kind":"found_in_text","path":"repo2docker/__main__.py","file_url":"https://github.com/AIcrowd/repo2docker/blob/HEAD/repo2docker/__main__.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6481b74df8d09f73"}},{"code_sha256_prefix":"b9a1535d27f2a9fb","entry":"versions_from_parentdir","repo":"AIcrowd/repo2docker","repo_kind":"found_in_text","path":"repo2docker/_version.py","file_url":"https://github.com/AIcrowd/repo2docker/blob/HEAD/repo2docker/_version.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"b9a1535d27f2a9fb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}