{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/benchmarking-the-robustness-of-lidar-semantic","title":"Benchmarking the Robustness of LiDAR Semantic Segmentation Models","arxiv_id":"2301.00970","date":"2023-01-03","proceeding":null,"authors":["Xu Yan","Chaoda Zheng","Ying Xue","Zhen Li","Shuguang Cui","Dengxin Dai"],"abstract":"When using LiDAR semantic segmentation models for safety-critical applications such as autonomous driving, it is essential to understand and improve their robustness with respect to a large range of LiDAR corruptions. In this paper, we aim to comprehensively analyze the robustness of LiDAR semantic segmentation models under various corruptions. To rigorously evaluate the robustness and generalizability of current approaches, we propose a new benchmark called SemanticKITTI-C, which features 16 out-of-domain LiDAR corruptions in three groups, namely adverse weather, measurement noise and cross-device discrepancy. Then, we systematically investigate 11 LiDAR semantic segmentation models, especially spanning different input representations (e.g., point clouds, voxels, projected images, and etc.), network architectures and training schemes. Through this study, we obtain two insights: 1) We find out that the input representation plays a crucial role in robustness. Specifically, under specific corruptions, different representations perform variously. 2) Although state-of-the-art methods on LiDAR semantic segmentation achieve promising results on clean data, they are less robust when dealing with noisy data. Finally, based on the above observations, we design a robust LiDAR segmentation model (RLSeg) which greatly boosts the robustness with simple but effective modifications. It is promising that our benchmark, comprehensive analysis, and observations can boost future research in robust LiDAR semantic segmentation for safety-critical applications.","url_abs":"https://arxiv.org/abs/2301.00970v3","url_pdf":"https://arxiv.org/pdf/2301.00970v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"benchmarking-the-robustness-of-lidar-semantic","repo_url":"https://github.com/yanx27/2dpass","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"lidar-semantic-segmentation","task_name":"LIDAR Semantic Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2301.00970","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.00970"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yanx27/2dpass","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":2,"ran_violates":1,"unverified":6},"by_repo_kind":{"official":{"samples":9,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d94639b28b2134ff","entry":"iou","repo":"yanx27/2dpass","repo_kind":"official","path":"utils/lovasz_loss.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/utils/lovasz_loss.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d94639b28b2134ff"}},{"code_sha256_prefix":"1211530cd527bd0b","entry":"iou_binary","repo":"yanx27/2dpass","repo_kind":"official","path":"utils/lovasz_loss.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/utils/lovasz_loss.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1211530cd527bd0b"}},{"code_sha256_prefix":"e85b5d21dc5b8382","entry":"lovasz_grad","repo":"yanx27/2dpass","repo_kind":"official","path":"utils/lovasz_loss.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/utils/lovasz_loss.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e85b5d21dc5b8382"}},{"code_sha256_prefix":"d3bb0ee0949cc3e8","entry":"get_SemKITTI_label_name","repo":"yanx27/2dpass","repo_kind":"official","path":"dataloader/pc_dataset.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/dataloader/pc_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3bb0ee0949cc3e8"}},{"code_sha256_prefix":"2d42162c0515f3c2","entry":"get_model_class","repo":"yanx27/2dpass","repo_kind":"official","path":"dataloader/dataset.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/dataloader/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2d42162c0515f3c2"}},{"code_sha256_prefix":"dc3115f6b6438996","entry":"get_pc_model_class","repo":"yanx27/2dpass","repo_kind":"official","path":"dataloader/pc_dataset.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/dataloader/pc_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc3115f6b6438996"}},{"code_sha256_prefix":"06862a8b7c8cf6fc","entry":"register_collate_fn","repo":"yanx27/2dpass","repo_kind":"official","path":"dataloader/dataset.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/dataloader/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06862a8b7c8cf6fc"}},{"code_sha256_prefix":"c134fed586d67760","entry":"register_dataset","repo":"yanx27/2dpass","repo_kind":"official","path":"dataloader/dataset.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/dataloader/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c134fed586d67760"}},{"code_sha256_prefix":"06a0e2786c57fc38","entry":"register_dataset","repo":"yanx27/2dpass","repo_kind":"official","path":"dataloader/pc_dataset.py","file_url":"https://github.com/yanx27/2dpass/blob/HEAD/dataloader/pc_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06a0e2786c57fc38"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}