{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/centerformer-center-based-transformer-for-3d","title":"CenterFormer: Center-based Transformer for 3D Object Detection","arxiv_id":"2209.05588","date":"2022-09-12","proceeding":null,"authors":["Zixiang Zhou","Xiangchen Zhao","Yu Wang","Panqu Wang","Hassan Foroosh"],"abstract":"Query-based transformer has shown great potential in constructing long-range attention in many image-domain tasks, but has rarely been considered in LiDAR-based 3D object detection due to the overwhelming size of the point cloud data. In this paper, we propose CenterFormer, a center-based transformer network for 3D object detection. CenterFormer first uses a center heatmap to select center candidates on top of a standard voxel-based point cloud encoder. It then uses the feature of the center candidate as the query embedding in the transformer. To further aggregate features from multiple frames, we design an approach to fuse features through cross-attention. Lastly, regression heads are added to predict the bounding box on the output center feature representation. Our design reduces the convergence difficulty and computational complexity of the transformer structure. The results show significant improvements over the strong baseline of anchor-free object detection networks. CenterFormer achieves state-of-the-art performance for a single model on the Waymo Open Dataset, with 73.7% mAPH on the validation set and 75.6% mAPH on the test set, significantly outperforming all previously published CNN and transformer-based methods. Our code is publicly available at https://github.com/TuSimple/centerformer","url_abs":"https://arxiv.org/abs/2209.05588v1","url_pdf":"https://arxiv.org/pdf/2209.05588v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"centerformer-center-based-transformer-for-3d","repo_url":"https://github.com/tusimple/centerformer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"heatmap","method_name":"Heatmap"},{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-object-detection-on-waymo-open-dataset","task":"3D Object Detection","dataset":"Waymo Open Dataset","model":"CenterFormer","rank_in_archive_order":7,"of":8,"metrics":{"mAPH/L2":"68.9"},"uses_additional_data":false},{"leaderboard":"/sota/3d-object-detection-on-waymo-cyclist","task":"3D Object Detection","dataset":"waymo cyclist","model":"CenterFormer","rank_in_archive_order":2,"of":7,"metrics":{"APH/L2":"73.3"},"uses_additional_data":false},{"leaderboard":"/sota/3d-object-detection-on-waymo-pedestrian","task":"3D Object Detection","dataset":"waymo pedestrian","model":"CenterFormer","rank_in_archive_order":3,"of":7,"metrics":{"APH/L2":"75.0"},"uses_additional_data":false},{"leaderboard":"/sota/3d-object-detection-on-waymo-vehicle","task":"3D Object Detection","dataset":"waymo vehicle","model":"CenterFormer","rank_in_archive_order":3,"of":8,"metrics":{"APH/L2":"73.8"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2209.05588","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.05588"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tusimple/centerformer","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/TuSimple/centerformer","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f275792db636f6c2","entry":"Attention","repo":"TuSimple/centerformer","repo_kind":"official","path":"det3d/models/utils/transformer.py","file_url":"https://github.com/TuSimple/centerformer/blob/HEAD/det3d/models/utils/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f275792db636f6c2"}},{"code_sha256_prefix":"93c62cc8cf84c976","entry":"Cross_attention","repo":"TuSimple/centerformer","repo_kind":"official","path":"det3d/models/utils/transformer.py","file_url":"https://github.com/TuSimple/centerformer/blob/HEAD/det3d/models/utils/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"93c62cc8cf84c976"}},{"code_sha256_prefix":"5bed147705c744c0","entry":"FeedForward","repo":"TuSimple/centerformer","repo_kind":"official","path":"det3d/models/utils/transformer.py","file_url":"https://github.com/TuSimple/centerformer/blob/HEAD/det3d/models/utils/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5bed147705c744c0"}},{"code_sha256_prefix":"df7c47c3705203bd","entry":"GELU","repo":"TuSimple/centerformer","repo_kind":"official","path":"det3d/models/utils/transformer.py","file_url":"https://github.com/TuSimple/centerformer/blob/HEAD/det3d/models/utils/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df7c47c3705203bd"}},{"code_sha256_prefix":"c08a897ca7755fd5","entry":"PreNorm_CA","repo":"TuSimple/centerformer","repo_kind":"official","path":"det3d/models/utils/transformer.py","file_url":"https://github.com/TuSimple/centerformer/blob/HEAD/det3d/models/utils/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c08a897ca7755fd5"}},{"code_sha256_prefix":"c5bfe39beec59e53","entry":"Transformer","repo":"TuSimple/centerformer","repo_kind":"official","path":"det3d/models/utils/transformer.py","file_url":"https://github.com/TuSimple/centerformer/blob/HEAD/det3d/models/utils/transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c5bfe39beec59e53"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}