{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2509-13347","title":"OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraft","arxiv_id":"2509.13347","date":"2025-09-13","proceeding":"ICML","authors":["Zihao Wang","Muyao Li","Kaichen He","Xiangyu Wang","Zhancun Mu","Anji Liu","Yitao Liang"],"abstract":"The choice of action spaces is a critical yet unresolved challenge in developing capable, end-to-end trainable agents. This paper first presents a large-scale, systematic comparison of prominent abstracted action spaces and tokenizers for Vision-Language-Action (VLA) or hierarchical agent models in the open-ended Minecraft. Our analysis reveals that no single action space is universally optimal; instead, the most effective abstraction is highly task-dependent, creating a dilemma for building generalist agents. To resolve this, we introduce Chain of Action (CoA), a novel framework that unifies high-level planning and low-level control within a single, monolithic VLA model. CoA treats an abstracted action not as a command for a separate policy, but as an intermediate reasoning step--akin to a chain of thought--that guides the generation of the final, executable action. Furthermore, we demonstrate that an All-in-One agent trained on a diverse mixture of action spaces using the CoA paradigm learns a more robust and generalizable policy. This unified agent achieves a new state-of-the-art, improving the overall task success rate over strong, specialized baselines. To foster reproducible research, we release the OpenHA (Open Hierarchical Agents) suite, which includes our comprehensive benchmark of over 800 distinct tasks, curated datasets, source code, and all pretrained model checkpoints at https://github.com/CraftJarvis/OpenHA","url_abs":"https://arxiv.org/abs/2509.13347","url_pdf":"https://arxiv.org/pdf/2509.13347","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2509.13347","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2509.13347"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/CraftJarvis/OpenHA","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":16},"by_repo_kind":{"found_in_text":{"samples":16,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"de2d52fbfeb243b9","entry":"auto_wrap_text","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/render.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/render.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de2d52fbfeb243b9"}},{"code_sha256_prefix":"c8e5b3681d41b8a9","entry":"compute_gigpo_outcome_advantage","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"CrossAgent/MTRL/gigpo/core_gigpo.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/CrossAgent/MTRL/gigpo/core_gigpo.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c8e5b3681d41b8a9"}},{"code_sha256_prefix":"ee0301f4af48111e","entry":"draw_point","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/render.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/render.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ee0301f4af48111e"}},{"code_sha256_prefix":"41e403f45c23ce3b","entry":"encode_image_base64","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/agents/base.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/agents/base.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"41e403f45c23ce3b"}},{"code_sha256_prefix":"88b130da4fa553b6","entry":"encode_image_to_base64","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/agents/base.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/agents/base.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"88b130da4fa553b6"}},{"code_sha256_prefix":"08adf2e407bc8676","entry":"encode_image_to_bytes","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/img_utils.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/img_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"08adf2e407bc8676"}},{"code_sha256_prefix":"53fff504bc20bd79","entry":"encode_image_to_np","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/img_utils.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/img_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53fff504bc20bd79"}},{"code_sha256_prefix":"112a4c7ed0067c3f","entry":"encode_image_to_pil","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/img_utils.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/img_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"112a4c7ed0067c3f"}},{"code_sha256_prefix":"68e2f6de47802dd0","entry":"encode_obs","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/agents/base.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/agents/base.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68e2f6de47802dd0"}},{"code_sha256_prefix":"482928691e39c3f1","entry":"extract_grounding","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/extract.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/extract.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"482928691e39c3f1"}},{"code_sha256_prefix":"201afe2cea4e7598","entry":"extract_point","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/extract.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/extract.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"201afe2cea4e7598"}},{"code_sha256_prefix":"d731e07191652acd","entry":"extract_skill","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/extract.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/extract.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d731e07191652acd"}},{"code_sha256_prefix":"64983a39d0c8e9b0","entry":"load_json_file","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/file_op.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/file_op.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"64983a39d0c8e9b0"}},{"code_sha256_prefix":"3ac774349fa56ea5","entry":"load_jsonl","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/utils/file_op.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/utils/file_op.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3ac774349fa56ea5"}},{"code_sha256_prefix":"473cd4f42b98ef49","entry":"load_visual_model","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"openagents/agents/utils/load_model.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/openagents/agents/utils/load_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"473cd4f42b98ef49"}},{"code_sha256_prefix":"ce13314a36eff98b","entry":"to_hashable","repo":"CraftJarvis/OpenHA","repo_kind":"found_in_text","path":"CrossAgent/MTRL/gigpo/core_gigpo.py","file_url":"https://github.com/CraftJarvis/OpenHA/blob/HEAD/CrossAgent/MTRL/gigpo/core_gigpo.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce13314a36eff98b"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.AI","source":"arxiv_api"},"syntology_extracted_results":null}