{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hazard-challenge-embodied-decision-making-in","title":"HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments","arxiv_id":"2401.12975","date":"2024-01-23","proceeding":null,"authors":["Qinhong Zhou","Sunli Chen","Yisong Wang","Haozhe Xu","Weihua Du","Hongxin Zhang","Yilun Du","Joshua B. Tenenbaum","Chuang Gan"],"abstract":"Recent advances in high-fidelity virtual environments serve as one of the major driving forces for building intelligent embodied agents to perceive, reason and interact with the physical world. Typically, these environments remain unchanged unless agents interact with them. However, in real-world scenarios, agents might also face dynamically changing environments characterized by unexpected events and need to rapidly take action accordingly. To remedy this gap, we propose a new simulated embodied benchmark, called HAZARD, specifically designed to assess the decision-making abilities of embodied agents in dynamic situations. HAZARD consists of three unexpected disaster scenarios, including fire, flood, and wind, and specifically supports the utilization of large language models (LLMs) to assist common sense reasoning and decision-making. This benchmark enables us to evaluate autonomous agents' decision-making capabilities across various pipelines, including reinforcement learning (RL), rule-based, and search-based methods in dynamically changing environments. As a first step toward addressing this challenge using large language models, we further develop an LLM-based agent and perform an in-depth analysis of its promise and challenge of solving these challenging tasks. HAZARD is available at https://vis-www.cs.umass.edu/hazard/.","url_abs":"https://arxiv.org/abs/2401.12975v1","url_pdf":"https://arxiv.org/pdf/2401.12975v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hazard-challenge-embodied-decision-making-in","repo_url":"https://github.com/umass-foundation-model/hazard","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"tasks":[{"task_slug":"common-sense-reasoning","task_name":"Common Sense Reasoning"},{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2401.12975","atlas_url":"https://app.syntology.ai/?focus=2401.12975","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.12975"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/umass-foundation-model/hazard","reach":{"status":"ok","spdx":"BSD-2-Clause"}}],"summary":{"ran":6},"by_repo_kind":{"official":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0c4dab4a665fb789","entry":"check_mergeable","repo":"umass-foundation-model/hazard","repo_kind":"official","path":"src/HAZARD/policy/astar.py","file_url":"https://github.com/umass-foundation-model/hazard/blob/HEAD/src/HAZARD/policy/astar.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"0c4dab4a665fb789"}},{"code_sha256_prefix":"1a5fc27873c20c1a","entry":"get_target_description","repo":"umass-foundation-model/hazard","repo_kind":"official","path":"src/HAZARD/challenge.py","file_url":"https://github.com/umass-foundation-model/hazard/blob/HEAD/src/HAZARD/challenge.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1a5fc27873c20c1a"}},{"code_sha256_prefix":"2ae9a3a353d49628","entry":"get_target_ids","repo":"umass-foundation-model/hazard","repo_kind":"official","path":"src/HAZARD/challenge.py","file_url":"https://github.com/umass-foundation-model/hazard/blob/HEAD/src/HAZARD/challenge.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"2ae9a3a353d49628"}},{"code_sha256_prefix":"8eb7880b603ab353","entry":"get_target_name","repo":"umass-foundation-model/hazard","repo_kind":"official","path":"src/HAZARD/challenge.py","file_url":"https://github.com/umass-foundation-model/hazard/blob/HEAD/src/HAZARD/challenge.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"8eb7880b603ab353"}},{"code_sha256_prefix":"142f98403b7adfd0","entry":"low_level_action","repo":"umass-foundation-model/hazard","repo_kind":"official","path":"src/HAZARD/policy/env_actions.py","file_url":"https://github.com/umass-foundation-model/hazard/blob/HEAD/src/HAZARD/policy/env_actions.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"142f98403b7adfd0"}},{"code_sha256_prefix":"6b524aa8efe7bc7a","entry":"path_cleanup","repo":"umass-foundation-model/hazard","repo_kind":"official","path":"src/HAZARD/policy/astar.py","file_url":"https://github.com/umass-foundation-model/hazard/blob/HEAD/src/HAZARD/policy/astar.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-2-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6b524aa8efe7bc7a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}