{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/simpb-a-single-model-for-2d-and-3d-object","title":"SimPB: A Single Model for 2D and 3D Object Detection from Multiple Cameras","arxiv_id":"2403.10353","date":"2024-03-15","proceeding":null,"authors":["Yingqi Tang","Zhaotie Meng","Guoliang Chen","Erkang Cheng"],"abstract":"The field of autonomous driving has attracted considerable interest in approaches that directly infer 3D objects in the Bird's Eye View (BEV) from multiple cameras. Some attempts have also explored utilizing 2D detectors from single images to enhance the performance of 3D detection. However, these approaches rely on a two-stage process with separate detectors, where the 2D detection results are utilized only once for token selection or query initialization. In this paper, we present a single model termed SimPB, which simultaneously detects 2D objects in the perspective view and 3D objects in the BEV space from multiple cameras. To achieve this, we introduce a hybrid decoder consisting of several multi-view 2D decoder layers and several 3D decoder layers, specifically designed for their respective detection tasks. A Dynamic Query Allocation module and an Adaptive Query Aggregation module are proposed to continuously update and refine the interaction between 2D and 3D results, in a cyclic 3D-2D-3D manner. Additionally, Query-group Attention is utilized to strengthen the interaction among 2D queries within each camera group. In the experiments, we evaluate our method on the nuScenes dataset and demonstrate promising results for both 2D and 3D detection tasks. Our code is available at: https://github.com/nullmax-vision/SimPB.","url_abs":"https://arxiv.org/abs/2403.10353v2","url_pdf":"https://arxiv.org/pdf/2403.10353v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"simpb-a-single-model-for-2d-and-3d-object","repo_url":"https://github.com/nullmax-vision/simpb","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.10353","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.10353"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/nullmax-vision/SimPB","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":2,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6515dd44533e4a2b","entry":"get_reference_points","repo":"nullmax-vision/SimPB","repo_kind":"official","path":"projects/mmdet3d_plugin/models/utils.py","file_url":"https://github.com/nullmax-vision/SimPB/blob/HEAD/projects/mmdet3d_plugin/models/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6515dd44533e4a2b"}},{"code_sha256_prefix":"aef7b421ef8bf22e","entry":"get_valid_ratio","repo":"nullmax-vision/SimPB","repo_kind":"official","path":"projects/mmdet3d_plugin/models/utils.py","file_url":"https://github.com/nullmax-vision/SimPB/blob/HEAD/projects/mmdet3d_plugin/models/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aef7b421ef8bf22e"}},{"code_sha256_prefix":"83c03ceb1307c6c4","entry":"inverse_sigmoid","repo":"nullmax-vision/SimPB","repo_kind":"official","path":"projects/mmdet3d_plugin/models/group_attn.py","file_url":"https://github.com/nullmax-vision/SimPB/blob/HEAD/projects/mmdet3d_plugin/models/group_attn.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"83c03ceb1307c6c4"}},{"code_sha256_prefix":"82c79d0ad5cc7f82","entry":"topk","repo":"nullmax-vision/SimPB","repo_kind":"official","path":"projects/mmdet3d_plugin/models/instance_bank.py","file_url":"https://github.com/nullmax-vision/SimPB/blob/HEAD/projects/mmdet3d_plugin/models/instance_bank.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"82c79d0ad5cc7f82"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}