{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/vista-boosting-3d-object-detection-via-dual","title":"VISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attention","arxiv_id":"2203.09704","date":"2022-03-18","proceeding":"CVPR 2022 1","authors":["Shengheng Deng","Zhihao Liang","Lin Sun","Kui Jia"],"abstract":"Detecting objects from LiDAR point clouds is of tremendous significance in autonomous driving. In spite of good progress, accurate and reliable 3D detection is yet to be achieved due to the sparsity and irregularity of LiDAR point clouds. Among existing strategies, multi-view methods have shown great promise by leveraging the more comprehensive information from both bird's eye view (BEV) and range view (RV). These multi-view methods either refine the proposals predicted from single view via fused features, or fuse the features without considering the global spatial context; their performance is limited consequently. In this paper, we propose to adaptively fuse multi-view features in a global spatial context via Dual Cross-VIew SpaTial Attention (VISTA). The proposed VISTA is a novel plug-and-play fusion module, wherein the multi-layer perceptron widely adopted in standard attention modules is replaced with a convolutional one. Thanks to the learned attention mechanism, VISTA can produce fused features of high quality for prediction of proposals. We decouple the classification and regression tasks in VISTA, and an additional constraint of attention variance is applied that enables the attention module to focus on specific targets instead of generic points. We conduct thorough experiments on the benchmarks of nuScenes and Waymo; results confirm the efficacy of our designs. At the time of submission, our method achieves 63.0% in overall mAP and 69.8% in NDS on the nuScenes benchmark, outperforming all published methods by up to 24% in safety-crucial categories such as cyclist. The source code in PyTorch is available at https://github.com/Gorilla-Lab-SCUT/VISTA","url_abs":"https://arxiv.org/abs/2203.09704v1","url_pdf":"https://arxiv.org/pdf/2203.09704v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"vista-boosting-3d-object-detection-via-dual","repo_url":"https://github.com/gorilla-lab-scut/vista","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.09704","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.09704"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gorilla-lab-scut/vista","reach":null}],"summary":{"ran":3,"unverified":3},"by_repo_kind":{"official":{"samples":6,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"454b8f02ab6bbe9a","entry":"FeedFowardLayer","repo":"gorilla-lab-scut/vista","repo_kind":"official","path":"det3d/models/necks/attention.py","file_url":"https://github.com/gorilla-lab-scut/vista/blob/HEAD/det3d/models/necks/attention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"454b8f02ab6bbe9a"}},{"code_sha256_prefix":"a987ce5d867c57c1","entry":"PositionEmbeddingLearned","repo":"gorilla-lab-scut/vista","repo_kind":"official","path":"det3d/models/necks/attention.py","file_url":"https://github.com/gorilla-lab-scut/vista/blob/HEAD/det3d/models/necks/attention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a987ce5d867c57c1"}},{"code_sha256_prefix":"bfe62e91fee72af7","entry":"Registry","repo":"gorilla-lab-scut/vista","repo_kind":"official","path":"det3d/models/necks/attention.py","file_url":"https://github.com/gorilla-lab-scut/vista/blob/HEAD/det3d/models/necks/attention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bfe62e91fee72af7"}},{"code_sha256_prefix":"3c5c9c21543874a6","entry":"ConvAttentionLayer_Decouple","repo":"gorilla-lab-scut/vista","repo_kind":"official","path":"det3d/models/necks/attention.py","file_url":"https://github.com/gorilla-lab-scut/vista/blob/HEAD/det3d/models/necks/attention.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c5c9c21543874a6"}},{"code_sha256_prefix":"bce40986b468ff7e","entry":"CrossAttenBlock_Decouple","repo":"gorilla-lab-scut/vista","repo_kind":"official","path":"det3d/models/necks/attention.py","file_url":"https://github.com/gorilla-lab-scut/vista/blob/HEAD/det3d/models/necks/attention.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bce40986b468ff7e"}},{"code_sha256_prefix":"df4584cc87da9493","entry":"Cross_Attention_Decouple","repo":"gorilla-lab-scut/vista","repo_kind":"official","path":"det3d/models/necks/attention.py","file_url":"https://github.com/gorilla-lab-scut/vista/blob/HEAD/det3d/models/necks/attention.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df4584cc87da9493"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}