{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-solving-fuzzy-tasks-with-human","title":"Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition","arxiv_id":"2303.13512","date":"2023-03-23","proceeding":null,"authors":["Stephanie Milani","Anssi Kanervisto","Karolis Ramanauskas","Sander Schulhoff","Brandon Houghton","Sharada Mohanty","Byron Galbraith","Ke Chen","Yan Song","Tianze Zhou","Bingquan Yu","He Liu","Kai Guan","Yujing Hu","Tangjie Lv","Federico Malato","Florian Leopold","Amogh Raut","Ville Hautamäki","Andrew Melnik","Shu Ishida","João F. Henriques","Robert Klassert","Walter Laurito","Ellen Novoseller","Vinicius G. Goecks","Nicholas Waytowich","David Watkins","Josh Miller","Rohin Shah"],"abstract":"To facilitate research in the direction of fine-tuning foundation models from human feedback, we held the MineRL BASALT Competition on Fine-Tuning from Human Feedback at NeurIPS 2022. The BASALT challenge asks teams to compete to develop algorithms to solve tasks with hard-to-specify reward functions in Minecraft. Through this competition, we aimed to promote the development of algorithms that use human feedback as channels to learn the desired behavior. We describe the competition and provide an overview of the top solutions. We conclude by discussing the impact of the competition and future directions for improvement.","url_abs":"https://arxiv.org/abs/2303.13512v1","url_pdf":"https://arxiv.org/pdf/2303.13512v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"minecraft","task_name":"Minecraft"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.13512","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.13512"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/shuishida/minerl_2022","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/BASALT-2022-Karlsruhe/ka-basalt-2022","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/nwayt001/preference-IQL","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":2,"ran":1,"unverified":5},"by_repo_kind":{"found_in_text":{"samples":8,"ran":3,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b2300f16257d73e9","entry":"json_action_to_env_action","repo":"BASALT-2022-Karlsruhe/ka-basalt-2022","repo_kind":"found_in_text","path":"data_loader.py","file_url":"https://github.com/BASALT-2022-Karlsruhe/ka-basalt-2022/blob/HEAD/data_loader.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2300f16257d73e9"}},{"code_sha256_prefix":"b5f9bf2f6cbd78b7","entry":"load_model_parameters","repo":"BASALT-2022-Karlsruhe/ka-basalt-2022","repo_kind":"found_in_text","path":"behavioural_cloning.py","file_url":"https://github.com/BASALT-2022-Karlsruhe/ka-basalt-2022/blob/HEAD/behavioural_cloning.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b5f9bf2f6cbd78b7"}},{"code_sha256_prefix":"69a190b789185068","entry":"resize_image","repo":"shuishida/minerl_2022","repo_kind":"found_in_text","path":"openai_vpt/agent.py","file_url":"https://github.com/shuishida/minerl_2022/blob/HEAD/openai_vpt/agent.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"69a190b789185068"}},{"code_sha256_prefix":"612ab1f687996e5d","entry":"count_stacks","repo":"BASALT-2022-Karlsruhe/ka-basalt-2022","repo_kind":"found_in_text","path":"find_cave_classifier.py","file_url":"https://github.com/BASALT-2022-Karlsruhe/ka-basalt-2022/blob/HEAD/find_cave_classifier.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"612ab1f687996e5d"}},{"code_sha256_prefix":"a122fbe2c60c2357","entry":"get_demo_trajectories","repo":"BASALT-2022-Karlsruhe/ka-basalt-2022","repo_kind":"found_in_text","path":"prep_demos.py","file_url":"https://github.com/BASALT-2022-Karlsruhe/ka-basalt-2022/blob/HEAD/prep_demos.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a122fbe2c60c2357"}},{"code_sha256_prefix":"c7cbec0e8325ee42","entry":"get_env_name","repo":"shuishida/minerl_2022","repo_kind":"found_in_text","path":"const.py","file_url":"https://github.com/shuishida/minerl_2022/blob/HEAD/const.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7cbec0e8325ee42"}},{"code_sha256_prefix":"3068d1f66fb12555","entry":"get_length_diff","repo":"BASALT-2022-Karlsruhe/ka-basalt-2022","repo_kind":"found_in_text","path":"prep_demos.py","file_url":"https://github.com/BASALT-2022-Karlsruhe/ka-basalt-2022/blob/HEAD/prep_demos.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3068d1f66fb12555"}},{"code_sha256_prefix":"e58c3ad8f2cb103a","entry":"is_short","repo":"BASALT-2022-Karlsruhe/ka-basalt-2022","repo_kind":"found_in_text","path":"prep_demos.py","file_url":"https://github.com/BASALT-2022-Karlsruhe/ka-basalt-2022/blob/HEAD/prep_demos.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e58c3ad8f2cb103a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}