{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/lidar-nerf-novel-lidar-view-synthesis-via","title":"LiDAR-NeRF: Novel LiDAR View Synthesis via Neural Radiance Fields","arxiv_id":"2304.10406","date":"2023-04-20","proceeding":null,"authors":["Tang Tao","Longfei Gao","Guangrun Wang","Yixing Lao","Peng Chen","Hengshuang Zhao","Dayang Hao","Xiaodan Liang","Mathieu Salzmann","Kaicheng Yu"],"abstract":"We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic LiDAR patterns because the renderers rely on explicit 3D reconstruction and exploit game engines, that ignore important attributes of LiDAR points. We address this challenge by formulating, to the best of our knowledge, the first differentiable end-to-end LiDAR rendering framework, LiDAR-NeRF, leveraging a neural radiance field (NeRF) to facilitate the joint learning of geometry and the attributes of 3D points. However, simply employing NeRF cannot achieve satisfactory results, as it only focuses on learning individual pixels while ignoring local information, especially at low texture areas, resulting in poor geometry. To this end, we have taken steps to address this issue by introducing a structural regularization method to preserve local structural details. To evaluate the effectiveness of our approach, we establish an object-centric multi-view LiDAR dataset, dubbed NeRF-MVL. It contains observations of objects from 9 categories seen from 360-degree viewpoints captured with multiple LiDAR sensors. Our extensive experiments on the scene-level KITTI-360 dataset, and on our object-level NeRF-MVL show that our LiDAR-NeRF surpasses the model-based algorithms significantly.","url_abs":"https://arxiv.org/abs/2304.10406v2","url_pdf":"https://arxiv.org/pdf/2304.10406v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"lidar-nerf-novel-lidar-view-synthesis-via","repo_url":"https://github.com/tangtaogo/lidar-nerf","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"nerf","task_name":"NeRF"},{"task_slug":"novel-lidar-view-synthesis","task_name":"Novel LiDAR View Synthesis"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"},{"task_slug":"style-transfer","task_name":"Style Transfer"}],"methods":[],"datasets_introduced":[{"slug":"nerf-mvl","name":"NeRF-MVL","full_name":"object-centric multi-view LiDAR dataset"}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2304.10406","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2304.10406"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tangtaogo/lidar-nerf","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":9,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":13,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c1cb6e3e76067a5d","entry":"dice_coeff","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnvs/unet.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnvs/unet.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1cb6e3e76067a5d"}},{"code_sha256_prefix":"02b5df44eb5c21a3","entry":"dice_loss","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnvs/unet.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnvs/unet.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"02b5df44eb5c21a3"}},{"code_sha256_prefix":"1929a5b8c241cd48","entry":"fscore","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"extern/fscore.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/extern/fscore.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1929a5b8c241cd48"}},{"code_sha256_prefix":"00979fadb02bf8df","entry":"huber_loss","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/loss.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/loss.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00979fadb02bf8df"}},{"code_sha256_prefix":"a1cbcfad9b7fd40b","entry":"lidar_to_pano_with_intensities","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/convert.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/convert.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a1cbcfad9b7fd40b"}},{"code_sha256_prefix":"df2164d2c1f74c1b","entry":"linear_to_srgb","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/nerf/utils.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/nerf/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df2164d2c1f74c1b"}},{"code_sha256_prefix":"ddcd1a350d11a260","entry":"mape_loss","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/loss.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/loss.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ddcd1a350d11a260"}},{"code_sha256_prefix":"9445687b9106e2f8","entry":"multiclass_dice_coeff","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnvs/unet.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnvs/unet.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9445687b9106e2f8"}},{"code_sha256_prefix":"8ed7b9fc7f33d1dd","entry":"sample_pdf","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/nerf/renderer.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/nerf/renderer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8ed7b9fc7f33d1dd"}},{"code_sha256_prefix":"78534c794e6d4ae8","entry":"srgb_to_linear","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/nerf/utils.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/nerf/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"78534c794e6d4ae8"}},{"code_sha256_prefix":"ad1506ac834a0958","entry":"filter_bbox_dataset","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/nerf/utils.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/nerf/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ad1506ac834a0958"}},{"code_sha256_prefix":"846c287e3db5197e","entry":"lidar_to_pano","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/convert.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/convert.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"846c287e3db5197e"}},{"code_sha256_prefix":"fcd40c17509b87bd","entry":"lidar_to_pano_with_intensities_with_bbox_mask","repo":"tangtaogo/lidar-nerf","repo_kind":"official","path":"lidarnerf/convert.py","file_url":"https://github.com/tangtaogo/lidar-nerf/blob/HEAD/lidarnerf/convert.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fcd40c17509b87bd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}