{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/l4dr-lidar-4dradar-fusion-for-weather-robust","title":"L4DR: LiDAR-4DRadar Fusion for Weather-Robust 3D Object Detection","arxiv_id":"2408.03677","date":"2024-08-07","proceeding":null,"authors":["Xun Huang","Ziyu Xu","Hai Wu","Jinlong Wang","Qiming Xia","Yan Xia","Jonathan Li","Kyle Gao","Chenglu Wen","Cheng Wang"],"abstract":"LiDAR-based vision systems are integral for 3D object detection, which is crucial for autonomous navigation. However, they suffer from performance degradation in adverse weather conditions due to the quality deterioration of LiDAR point clouds. Fusing LiDAR with the weather-robust 4D radar sensor is expected to solve this problem. However, the fusion of LiDAR and 4D radar is challenging because they differ significantly in terms of data quality and the degree of degradation in adverse weather. To address these issues, we introduce L4DR, a weather-robust 3D object detection method that effectively achieves LiDAR and 4D Radar fusion. Our L4DR includes Multi-Modal Encoding (MME) and Foreground-Aware Denoising (FAD) technique to reconcile sensor gaps, which is the first exploration of the complementarity of early fusion between LiDAR and 4D radar. Additionally, we design an Inter-Modal and Intra-Modal ({IM}2 ) parallel feature extraction backbone coupled with a Multi-Scale Gated Fusion (MSGF) module to counteract the varying degrees of sensor degradation under adverse weather conditions. Experimental evaluation on a VoD dataset with simulated fog proves that L4DR is more adaptable to changing weather conditions. It delivers a significant performance increase under different fog levels, improving the 3D mAP by up to 20.0% over the traditional LiDAR-only approach. Moreover, the results on the K-Radar dataset validate the consistent performance improvement of L4DR in real-world adverse weather conditions.","url_abs":"https://arxiv.org/abs/2408.03677v5","url_pdf":"https://arxiv.org/pdf/2408.03677v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"l4dr-lidar-4dradar-fusion-for-weather-robust","repo_url":"https://github.com/ylwhxht/l4dr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"autonomous-navigation","task_name":"Autonomous Navigation"},{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"fad","task_name":"FAD"},{"task_slug":"mme","task_name":"MME"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"robust-3d-object-detection","task_name":"Robust 3D Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2408.03677","atlas_url":"https://app.syntology.ai/?focus=2408.03677","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.03677"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ylwhxht/l4dr","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":3,"unverified":5},"by_repo_kind":{"official":{"samples":8,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3415a0d1c950c1c7","entry":"get_image_index_str","repo":"ylwhxht/l4dr","repo_kind":"official","path":"K-Radar-main-repo/main_tmp.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/K-Radar-main-repo/main_tmp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3415a0d1c950c1c7"}},{"code_sha256_prefix":"66ed6e5c50ded185","entry":"get_label_anno","repo":"ylwhxht/l4dr","repo_kind":"official","path":"K-Radar-main-repo/main_tmp.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/K-Radar-main-repo/main_tmp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"66ed6e5c50ded185"}},{"code_sha256_prefix":"4563670bb0faaaaa","entry":"get_label_annos","repo":"ylwhxht/l4dr","repo_kind":"official","path":"K-Radar-main-repo/main_tmp.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/K-Radar-main-repo/main_tmp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4563670bb0faaaaa"}},{"code_sha256_prefix":"44db2351bcc0bffe","entry":"cfg_from_yaml_file","repo":"ylwhxht/l4dr","repo_kind":"official","path":"pcdet/config.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/pcdet/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"44db2351bcc0bffe"}},{"code_sha256_prefix":"65fe32ede00e7dcb","entry":"compute_fg_mask","repo":"ylwhxht/l4dr","repo_kind":"official","path":"K-Radar-main-repo/utils/loss_utils.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/K-Radar-main-repo/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"65fe32ede00e7dcb"}},{"code_sha256_prefix":"1780d388cc532a6d","entry":"get_corner_loss_lidar","repo":"ylwhxht/l4dr","repo_kind":"official","path":"K-Radar-main-repo/utils/loss_utils.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/K-Radar-main-repo/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1780d388cc532a6d"}},{"code_sha256_prefix":"50e8e8cdfc5129f0","entry":"merge_new_config","repo":"ylwhxht/l4dr","repo_kind":"official","path":"pcdet/config.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/pcdet/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"50e8e8cdfc5129f0"}},{"code_sha256_prefix":"488b91d67a807558","entry":"neg_loss_cornernet","repo":"ylwhxht/l4dr","repo_kind":"official","path":"K-Radar-main-repo/utils/loss_utils.py","file_url":"https://github.com/ylwhxht/l4dr/blob/HEAD/K-Radar-main-repo/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"488b91d67a807558"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}