{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/understanding-the-robustness-of-3d-object","title":"Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving","arxiv_id":"2303.17297","date":"2023-03-30","proceeding":"CVPR 2023 1","authors":["Zijian Zhu","Yichi Zhang","Hai Chen","Yinpeng Dong","Shu Zhao","Wenbo Ding","Jiachen Zhong","Shibao Zheng"],"abstract":"3D object detection is an essential perception task in autonomous driving to understand the environments. The Bird's-Eye-View (BEV) representations have significantly improved the performance of 3D detectors with camera inputs on popular benchmarks. However, there still lacks a systematic understanding of the robustness of these vision-dependent BEV models, which is closely related to the safety of autonomous driving systems. In this paper, we evaluate the natural and adversarial robustness of various representative models under extensive settings, to fully understand their behaviors influenced by explicit BEV features compared with those without BEV. In addition to the classic settings, we propose a 3D consistent patch attack by applying adversarial patches in the 3D space to guarantee the spatiotemporal consistency, which is more realistic for the scenario of autonomous driving. With substantial experiments, we draw several findings: 1) BEV models tend to be more stable than previous methods under different natural conditions and common corruptions due to the expressive spatial representations; 2) BEV models are more vulnerable to adversarial noises, mainly caused by the redundant BEV features; 3) Camera-LiDAR fusion models have superior performance under different settings with multi-modal inputs, but BEV fusion model is still vulnerable to adversarial noises of both point cloud and image. These findings alert the safety issue in the applications of BEV detectors and could facilitate the development of more robust models.","url_abs":"https://arxiv.org/abs/2303.17297v2","url_pdf":"https://arxiv.org/pdf/2303.17297v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"understanding-the-robustness-of-3d-object","repo_url":"https://github.com/zzj403/BEV_Robust","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"adversarial-robustness","task_name":"Adversarial Robustness"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.17297","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.17297"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zzj403/BEV_Robust","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2e513382b128615e","entry":"apply_patches_by_info","repo":"zzj403/BEV_Robust","repo_kind":"official","path":"extend_common/patch_apply.py","file_url":"https://github.com/zzj403/BEV_Robust/blob/HEAD/extend_common/patch_apply.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2e513382b128615e"}},{"code_sha256_prefix":"a715171938ceefa0","entry":"proj_3d_to_2d","repo":"zzj403/BEV_Robust","repo_kind":"official","path":"extend_common/patch_apply.py","file_url":"https://github.com/zzj403/BEV_Robust/blob/HEAD/extend_common/patch_apply.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a715171938ceefa0"}},{"code_sha256_prefix":"fbbebd5b6e400aa0","entry":"safe_img_patch_apply","repo":"zzj403/BEV_Robust","repo_kind":"official","path":"extend_common/patch_apply.py","file_url":"https://github.com/zzj403/BEV_Robust/blob/HEAD/extend_common/patch_apply.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fbbebd5b6e400aa0"}},{"code_sha256_prefix":"1cd1a9a8d83da050","entry":"split_path_string_to_multiname","repo":"zzj403/BEV_Robust","repo_kind":"official","path":"extend_common/path_string_split.py","file_url":"https://github.com/zzj403/BEV_Robust/blob/HEAD/extend_common/path_string_split.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1cd1a9a8d83da050"}},{"code_sha256_prefix":"5680c45ee5f53767","entry":"time_counter","repo":"zzj403/BEV_Robust","repo_kind":"official","path":"extend_common/time_counter.py","file_url":"https://github.com/zzj403/BEV_Robust/blob/HEAD/extend_common/time_counter.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5680c45ee5f53767"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}