{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/improving-3d-object-detection-with-channel","title":"Improving 3D Object Detection with Channel-wise Transformer","arxiv_id":"2108.10723","date":"2021-08-23","proceeding":"ICCV 2021 10","authors":["Hualian Sheng","Sijia Cai","YuAn Liu","Bing Deng","Jianqiang Huang","Xian-Sheng Hua","Min-Jian Zhao"],"abstract":"Though 3D object detection from point clouds has achieved rapid progress in recent years, the lack of flexible and high-performance proposal refinement remains a great hurdle for existing state-of-the-art two-stage detectors. Previous works on refining 3D proposals have relied on human-designed components such as keypoints sampling, set abstraction and multi-scale feature fusion to produce powerful 3D object representations. Such methods, however, have limited ability to capture rich contextual dependencies among points. In this paper, we leverage the high-quality region proposal network and a Channel-wise Transformer architecture to constitute our two-stage 3D object detection framework (CT3D) with minimal hand-crafted design. The proposed CT3D simultaneously performs proposal-aware embedding and channel-wise context aggregation for the point features within each proposal. Specifically, CT3D uses proposal's keypoints for spatial contextual modelling and learns attention propagation in the encoding module, mapping the proposal to point embeddings. Next, a new channel-wise decoding module enriches the query-key interaction via channel-wise re-weighting to effectively merge multi-level contexts, which contributes to more accurate object predictions. Extensive experiments demonstrate that our CT3D method has superior performance and excellent scalability. Remarkably, CT3D achieves the AP of 81.77% in the moderate car category on the KITTI test 3D detection benchmark, outperforms state-of-the-art 3D detectors.","url_abs":"https://arxiv.org/abs/2108.10723v2","url_pdf":"https://arxiv.org/pdf/2108.10723v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"improving-3d-object-detection-with-channel","repo_url":"https://github.com/hlsheng1/ct3d","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"region-proposal","task_name":"Region Proposal"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"ct3d","method_name":"CT3D"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"rpn","method_name":"RPN"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2108.10723","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.10723"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hlsheng1/ct3d","reach":null}],"summary":{"ran":5,"ran_draft_wrong":1,"unverified":6},"by_repo_kind":{"official":{"samples":12,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"671c67f4433ae3c1","entry":"MultiHeadedAttention","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"671c67f4433ae3c1"}},{"code_sha256_prefix":"b41cfee48847d79e","entry":"TransformerDecoder","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b41cfee48847d79e"}},{"code_sha256_prefix":"2cb413b2d6fa8f2e","entry":"TransformerDecoderLayer","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2cb413b2d6fa8f2e"}},{"code_sha256_prefix":"10ec8fb6960c9e5e","entry":"TransformerEncoder","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"10ec8fb6960c9e5e"}},{"code_sha256_prefix":"9f90c23222eb4bbf","entry":"TransformerEncoderLayer","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9f90c23222eb4bbf"}},{"code_sha256_prefix":"f93d42eb62cfe6e7","entry":"attention","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f93d42eb62cfe6e7"}},{"code_sha256_prefix":"77a66a7bbe4e9a9c","entry":"CT3DHead","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"77a66a7bbe4e9a9c"}},{"code_sha256_prefix":"d54c911dcaa871cf","entry":"ProposalTargetLayer","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d54c911dcaa871cf"}},{"code_sha256_prefix":"443b75afeff90018","entry":"RoIHeadTemplate","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"443b75afeff90018"}},{"code_sha256_prefix":"443cb18b71862421","entry":"Transformer","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"443cb18b71862421"}},{"code_sha256_prefix":"2b5d92421f68b895","entry":"build_transformer","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b5d92421f68b895"}},{"code_sha256_prefix":"c0b17d12fe8897b3","entry":"class_agnostic_nms","repo":"hlsheng1/ct3d","repo_kind":"official","path":"pcdet/models/roi_heads/ct3d_head.py","file_url":"https://github.com/hlsheng1/ct3d/blob/HEAD/pcdet/models/roi_heads/ct3d_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c0b17d12fe8897b3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}