{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/out-of-the-box-embodied-navigation-in-the","title":"Out of the Box: Embodied Navigation in the Real World","arxiv_id":"2105.05873","date":"2021-05-12","proceeding":null,"authors":["Roberto Bigazzi","Federico Landi","Marcella Cornia","Silvia Cascianelli","Lorenzo Baraldi","Rita Cucchiara"],"abstract":"The research field of Embodied AI has witnessed substantial progress in visual navigation and exploration thanks to powerful simulating platforms and the availability of 3D data of indoor and photorealistic environments. These two factors have opened the doors to a new generation of intelligent agents capable of achieving nearly perfect PointGoal Navigation. However, such architectures are commonly trained with millions, if not billions, of frames and tested in simulation. Together with great enthusiasm, these results yield a question: how many researchers will effectively benefit from these advances? In this work, we detail how to transfer the knowledge acquired in simulation into the real world. To that end, we describe the architectural discrepancies that damage the Sim2Real adaptation ability of models trained on the Habitat simulator and propose a novel solution tailored towards the deployment in real-world scenarios. We then deploy our models on a LoCoBot, a Low-Cost Robot equipped with a single Intel RealSense camera. Different from previous work, our testing scene is unavailable to the agent in simulation. The environment is also inaccessible to the agent beforehand, so it cannot count on scene-specific semantic priors. In this way, we reproduce a setting in which a research group (potentially from other fields) needs to employ the agent visual navigation capabilities as-a-Service. Our experiments indicate that it is possible to achieve satisfying results when deploying the obtained model in the real world. Our code and models are available at https://github.com/aimagelab/LoCoNav.","url_abs":"https://arxiv.org/abs/2105.05873v1","url_pdf":"https://arxiv.org/pdf/2105.05873v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"out-of-the-box-embodied-navigation-in-the","repo_url":"https://github.com/aimagelab/LoCoNav","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"pointgoal-navigation","task_name":"PointGoal Navigation"},{"task_slug":"visual-navigation","task_name":"Visual Navigation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2105.05873","atlas_url":"https://app.syntology.ai/?focus=2105.05873","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.05873"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aimagelab/LoCoNav","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"unverified":6},"by_repo_kind":{"official":{"samples":7,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1070c77228a269fa","entry":"colorize_ego_map","repo":"aimagelab/LoCoNav","repo_kind":"official","path":"habitat_extensions/exploration_demo.py","file_url":"https://github.com/aimagelab/LoCoNav/blob/HEAD/habitat_extensions/exploration_demo.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1070c77228a269fa"}},{"code_sha256_prefix":"48a841fbb4ccd8dc","entry":"compute_spatial_locs","repo":"aimagelab/LoCoNav","repo_kind":"official","path":"occant_baselines/models/mapnet.py","file_url":"https://github.com/aimagelab/LoCoNav/blob/HEAD/occant_baselines/models/mapnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"48a841fbb4ccd8dc"}},{"code_sha256_prefix":"338337493b7310cd","entry":"draw_collision","repo":"aimagelab/LoCoNav","repo_kind":"official","path":"habitat_extensions/utils.py","file_url":"https://github.com/aimagelab/LoCoNav/blob/HEAD/habitat_extensions/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"338337493b7310cd"}},{"code_sha256_prefix":"c4118e240da0287c","entry":"quaternion_xyzw_to_wxyz","repo":"aimagelab/LoCoNav","repo_kind":"official","path":"habitat_extensions/geometry_utils.py","file_url":"https://github.com/aimagelab/LoCoNav/blob/HEAD/habitat_extensions/geometry_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4118e240da0287c"}},{"code_sha256_prefix":"99696627c60f24e7","entry":"softmax_2d","repo":"aimagelab/LoCoNav","repo_kind":"official","path":"occant_baselines/models/occant.py","file_url":"https://github.com/aimagelab/LoCoNav/blob/HEAD/occant_baselines/models/occant.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"99696627c60f24e7"}},{"code_sha256_prefix":"9f91091019fd02b9","entry":"to_grid","repo":"aimagelab/LoCoNav","repo_kind":"official","path":"habitat_extensions/maps.py","file_url":"https://github.com/aimagelab/LoCoNav/blob/HEAD/habitat_extensions/maps.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9f91091019fd02b9"}},{"code_sha256_prefix":"aeef4652506e5bbd","entry":"truncated_normal_noise_distr","repo":"aimagelab/LoCoNav","repo_kind":"official","path":"habitat_extensions/utils.py","file_url":"https://github.com/aimagelab/LoCoNav/blob/HEAD/habitat_extensions/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aeef4652506e5bbd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}