{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/renderable-neural-radiance-map-for-visual","title":"Renderable Neural Radiance Map for Visual Navigation","arxiv_id":"2303.00304","date":"2023-03-01","proceeding":"CVPR 2023 1","authors":["Obin Kwon","Jeongho Park","Songhwai Oh"],"abstract":"We propose a novel type of map for visual navigation, a renderable neural radiance map (RNR-Map), which is designed to contain the overall visual information of a 3D environment. The RNR-Map has a grid form and consists of latent codes at each pixel. These latent codes are embedded from image observations, and can be converted to the neural radiance field which enables image rendering given a camera pose. The recorded latent codes implicitly contain visual information about the environment, which makes the RNR-Map visually descriptive. This visual information in RNR-Map can be a useful guideline for visual localization and navigation. We develop localization and navigation frameworks that can effectively utilize the RNR-Map. We evaluate the proposed frameworks on camera tracking, visual localization, and image-goal navigation. Experimental results show that the RNR-Map-based localization framework can find the target location based on a single query image with fast speed and competitive accuracy compared to other baselines. Also, this localization framework is robust to environmental changes, and even finds the most visually similar places when a query image from a different environment is given. The proposed navigation framework outperforms the existing image-goal navigation methods in difficult scenarios, under odometry and actuation noises. The navigation framework shows 65.7% success rate in curved scenarios of the NRNS dataset, which is an improvement of 18.6% over the current state-of-the-art. Project page: https://rllab-snu.github.io/projects/RNR-Map/","url_abs":"https://arxiv.org/abs/2303.00304v4","url_pdf":"https://arxiv.org/pdf/2303.00304v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"renderable-neural-radiance-map-for-visual","repo_url":"https://github.com/intelligolabs/Le-RNR-Map","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"descriptive","task_name":"Descriptive"},{"task_slug":"visual-localization","task_name":"Visual Localization"},{"task_slug":"visual-navigation","task_name":"Visual Navigation"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.00304","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.00304"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/intelligolabs/Le-RNR-Map","reach":null}],"summary":{"ran_draft_wrong":3,"ran":4,"unverified":2},"by_repo_kind":{"listed":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"06401897001922fa","entry":"cumprod_exclusive","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"06401897001922fa"}},{"code_sha256_prefix":"dd0d055075f1b9e3","entry":"get_obj_from_str","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dd0d055075f1b9e3"}},{"code_sha256_prefix":"b78863ed255dc0a8","entry":"get_ray_bundle_batch","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b78863ed255dc0a8"}},{"code_sha256_prefix":"7bbd30aa1bf6fecf","entry":"get_sample_points","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7bbd30aa1bf6fecf"}},{"code_sha256_prefix":"4cfa72efcd0113d5","entry":"meshgrid_xy","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4cfa72efcd0113d5"}},{"code_sha256_prefix":"f26710c900731b73","entry":"sample_pdf_2","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f26710c900731b73"}},{"code_sha256_prefix":"97ff6acc2c01e17f","entry":"volume_render_radiance_field","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"97ff6acc2c01e17f"}},{"code_sha256_prefix":"5febd0195c7eae62","entry":"SceneGenerator","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5febd0195c7eae62"}},{"code_sha256_prefix":"a1df487b3854a798","entry":"instantiate_from_config","repo":"intelligolabs/Le-RNR-Map","repo_kind":"listed","path":"src/models/autoencoder/gsn/generator.py","file_url":"https://github.com/intelligolabs/Le-RNR-Map/blob/HEAD/src/models/autoencoder/gsn/generator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a1df487b3854a798"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}