{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/habitat-3-0-a-co-habitat-for-humans-avatars","title":"Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots","arxiv_id":"2310.13724","date":"2023-10-19","proceeding":null,"authors":["Xavier Puig","Eric Undersander","Andrew Szot","Mikael Dallaire Cote","Tsung-Yen Yang","Ruslan Partsey","Ruta Desai","Alexander William Clegg","Michal Hlavac","So Yeon Min","Vladimír Vondruš","Theophile Gervet","Vincent-Pierre Berges","John M. Turner","Oleksandr Maksymets","Zsolt Kira","Mrinal Kalakrishnan","Jitendra Malik","Devendra Singh Chaplot","Unnat Jain","Dhruv Batra","Akshara Rai","Roozbeh Mottaghi"],"abstract":"We present Habitat 3.0: a simulation platform for studying collaborative human-robot tasks in home environments. Habitat 3.0 offers contributions across three dimensions: (1) Accurate humanoid simulation: addressing challenges in modeling complex deformable bodies and diversity in appearance and motion, all while ensuring high simulation speed. (2) Human-in-the-loop infrastructure: enabling real human interaction with simulated robots via mouse/keyboard or a VR interface, facilitating evaluation of robot policies with human input. (3) Collaborative tasks: studying two collaborative tasks, Social Navigation and Social Rearrangement. Social Navigation investigates a robot's ability to locate and follow humanoid avatars in unseen environments, whereas Social Rearrangement addresses collaboration between a humanoid and robot while rearranging a scene. These contributions allow us to study end-to-end learned and heuristic baselines for human-robot collaboration in-depth, as well as evaluate them with humans in the loop. Our experiments demonstrate that learned robot policies lead to efficient task completion when collaborating with unseen humanoid agents and human partners that might exhibit behaviors that the robot has not seen before. Additionally, we observe emergent behaviors during collaborative task execution, such as the robot yielding space when obstructing a humanoid agent, thereby allowing the effective completion of the task by the humanoid agent. Furthermore, our experiments using the human-in-the-loop tool demonstrate that our automated evaluation with humanoids can provide an indication of the relative ordering of different policies when evaluated with real human collaborators. Habitat 3.0 unlocks interesting new features in simulators for Embodied AI, and we hope it paves the way for a new frontier of embodied human-AI interaction capabilities.","url_abs":"https://arxiv.org/abs/2310.13724v1","url_pdf":"https://arxiv.org/pdf/2310.13724v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"habitat-3-0-a-co-habitat-for-humans-avatars","repo_url":"https://github.com/Zeying-Gong/Falcon","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"habitat-3-0-a-co-habitat-for-humans-avatars","repo_url":"https://github.com/facebookresearch/habitat-api","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"habitat-3-0-a-co-habitat-for-humans-avatars","repo_url":"https://github.com/facebookresearch/habitat-lab","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"habitat-3-0-a-co-habitat-for-humans-avatars","repo_url":"https://github.com/facebookresearch/habitat-sim","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"social-navigation","task_name":"Social Navigation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.13724","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.13724"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Zeying-Gong/Falcon","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/habitat-sim","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/habitat-api","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/habitat-lab","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_violates":1,"ran":3,"ran_draft_wrong":1},"by_repo_kind":{"listed":{"samples":5,"ran":5,"repositories":4}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c363a358c75b4fb5","entry":"contains_inf_or_nan","repo":"Zeying-Gong/Falcon","repo_kind":"listed","path":"habitat-baselines/habitat_baselines/rl/ppo/falcon_trainer.py","file_url":"https://github.com/Zeying-Gong/Falcon/blob/HEAD/habitat-baselines/habitat_baselines/rl/ppo/falcon_trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c363a358c75b4fb5"}},{"code_sha256_prefix":"5083abf3cf062090","entry":"format_message","repo":"facebookresearch/habitat-sim","repo_kind":"listed","path":"src_python/habitat_sim/logging.py","file_url":"https://github.com/facebookresearch/habitat-sim/blob/HEAD/src_python/habitat_sim/logging.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5083abf3cf062090"}},{"code_sha256_prefix":"2b6973f475de4ee1","entry":"get_device","repo":"Zeying-Gong/Falcon","repo_kind":"listed","path":"habitat-baselines/habitat_baselines/rl/ppo/falcon_trainer.py","file_url":"https://github.com/Zeying-Gong/Falcon/blob/HEAD/habitat-baselines/habitat_baselines/rl/ppo/falcon_trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b6973f475de4ee1"}},{"code_sha256_prefix":"8e85ec247da5c1d7","entry":"omegaconf_to_object","repo":"facebookresearch/habitat-api","repo_kind":"listed","path":"habitat-hitl/habitat_hitl/core/hydra_utils.py","file_url":"https://github.com/facebookresearch/habitat-api/blob/HEAD/habitat-hitl/habitat_hitl/core/hydra_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8e85ec247da5c1d7"}},{"code_sha256_prefix":"87f9170f0641f3d3","entry":"tile_images","repo":"facebookresearch/habitat-lab","repo_kind":"listed","path":"habitat-lab/habitat/core/utils.py","file_url":"https://github.com/facebookresearch/habitat-lab/blob/HEAD/habitat-lab/habitat/core/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87f9170f0641f3d3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}