{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/point2seq-detecting-3d-objects-as-sequences","title":"Point2Seq: Detecting 3D Objects as Sequences","arxiv_id":"2203.13394","date":"2022-03-25","proceeding":"CVPR 2022 1","authors":["Yujing Xue","Jiageng Mao","Minzhe Niu","Hang Xu","Michael Bi Mi","Wei zhang","Xiaogang Wang","Xinchao Wang"],"abstract":"We present a simple and effective framework, named Point2Seq, for 3D object detection from point clouds. In contrast to previous methods that normally {predict attributes of 3D objects all at once}, we expressively model the interdependencies between attributes of 3D objects, which in turn enables a better detection accuracy. Specifically, we view each 3D object as a sequence of words and reformulate the 3D object detection task as decoding words from 3D scenes in an auto-regressive manner. We further propose a lightweight scene-to-sequence decoder that can auto-regressively generate words conditioned on features from a 3D scene as well as cues from the preceding words. The predicted words eventually constitute a set of sequences that completely describe the 3D objects in the scene, and all the predicted sequences are then automatically assigned to the respective ground truths through similarity-based sequence matching. Our approach is conceptually intuitive and can be readily plugged upon most existing 3D-detection backbones without adding too much computational overhead; the sequential decoding paradigm we proposed, on the other hand, can better exploit information from complex 3D scenes with the aid of preceding predicted words. Without bells and whistles, our method significantly outperforms previous anchor- and center-based 3D object detection frameworks, yielding the new state of the art on the challenging ONCE dataset as well as the Waymo Open Dataset. Code is available at \\url{https://github.com/ocNflag/point2seq}.","url_abs":"https://arxiv.org/abs/2203.13394v1","url_pdf":"https://arxiv.org/pdf/2203.13394v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"point2seq-detecting-3d-objects-as-sequences","repo_url":"https://github.com/ocnflag/point2seq","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.13394","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.13394"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ocnflag/point2seq","reach":null}],"summary":{"ran":7,"ran_fixture":4,"ran_draft_wrong":1,"ran_honours":1,"unverified":4},"by_repo_kind":{"official":{"samples":15,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"c3e53caad38b1bd3","entry":"BoxesIou3dDifferentiableFunction","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c3e53caad38b1bd3"}},{"code_sha256_prefix":"3edc8ae9bf725ed7","entry":"E2ESigmoidFocalClassificationLoss","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3edc8ae9bf725ed7"}},{"code_sha256_prefix":"5f96efdd4664c13e","entry":"GroundTruthProcessor","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5f96efdd4664c13e"}},{"code_sha256_prefix":"26bb8484040b20a5","entry":"OneNetSeqHeadTSC","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"26bb8484040b20a5"}},{"code_sha256_prefix":"6ca556054d761a3c","entry":"SmoothL1Loss","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6ca556054d761a3c"}},{"code_sha256_prefix":"887b3486b120474c","entry":"box_to_surface_bev","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"887b3486b120474c"}},{"code_sha256_prefix":"5c4bac81583c34e1","entry":"check_numpy_to_torch","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"5c4bac81583c34e1"}},{"code_sha256_prefix":"e78ed49296e4bb70","entry":"get_world_size","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e78ed49296e4bb70"}},{"code_sha256_prefix":"30d203cc642954ed","entry":"is_distributed","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"30d203cc642954ed"}},{"code_sha256_prefix":"0572d4f99dca2d49","entry":"label_to_one_hot","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0572d4f99dca2d49"}},{"code_sha256_prefix":"017ecc57a0af8b57","entry":"limit_period_torch","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"017ecc57a0af8b57"}},{"code_sha256_prefix":"df17a2b345c6cccd","entry":"rotate_points_along_z","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"df17a2b345c6cccd"}},{"code_sha256_prefix":"393718acf2b116e2","entry":"template_to_surface_bev","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"393718acf2b116e2"}},{"code_sha256_prefix":"97fa820cfae5e65d","entry":"E2ESeqHead","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"97fa820cfae5e65d"}},{"code_sha256_prefix":"9e12fe042064e780","entry":"IOU3DLoss","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9e12fe042064e780"}},{"code_sha256_prefix":"ffffba4bad43d9ed","entry":"OneNetSeqHead","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ffffba4bad43d9ed"}},{"code_sha256_prefix":"91ff85395933dcaf","entry":"SetCriterion","repo":"ocnflag/point2seq","repo_kind":"official","path":"pcdet/models/dense_heads/e2e_seq_head.py","file_url":"https://github.com/ocnflag/point2seq/blob/HEAD/pcdet/models/dense_heads/e2e_seq_head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"91ff85395933dcaf"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}