{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/petrv2-a-unified-framework-for-3d-perception","title":"PETRv2: A Unified Framework for 3D Perception from Multi-Camera Images","arxiv_id":"2206.01256","date":"2022-06-02","proceeding":"ICCV 2023 1","authors":["Yingfei Liu","Junjie Yan","Fan Jia","Shuailin Li","Aqi Gao","Tiancai Wang","Xiangyu Zhang","Jian Sun"],"abstract":"In this paper, we propose PETRv2, a unified framework for 3D perception from multi-view images. Based on PETR, PETRv2 explores the effectiveness of temporal modeling, which utilizes the temporal information of previous frames to boost 3D object detection. More specifically, we extend the 3D position embedding (3D PE) in PETR for temporal modeling. The 3D PE achieves the temporal alignment on object position of different frames. A feature-guided position encoder is further introduced to improve the data adaptability of 3D PE. To support for multi-task learning (e.g., BEV segmentation and 3D lane detection), PETRv2 provides a simple yet effective solution by introducing task-specific queries, which are initialized under different spaces. PETRv2 achieves state-of-the-art performance on 3D object detection, BEV segmentation and 3D lane detection. Detailed robustness analysis is also conducted on PETR framework. We hope PETRv2 can serve as a strong baseline for 3D perception. Code is available at \\url{https://github.com/megvii-research/PETR}.","url_abs":"https://arxiv.org/abs/2206.01256v3","url_pdf":"https://arxiv.org/pdf/2206.01256v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"petrv2-a-unified-framework-for-3d-perception","repo_url":"https://github.com/megvii-research/petr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"3d-lane-detection","task_name":"3D Lane Detection"},{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"bev-segmentation","task_name":"BEV Segmentation"},{"task_slug":"bird-s-eye-view-semantic-segmentation","task_name":"Bird's-Eye View Semantic Segmentation"},{"task_slug":"lane-detection","task_name":"Lane Detection"},{"task_slug":"multi-task-learning","task_name":"Multi-Task Learning"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":null,"task_name":"Position"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-lane-detection-on-openlane","task":"3D Lane Detection","dataset":"OpenLane","model":"PETRv2-V∗ (VoVNetV2 with 400 anchor points)","rank_in_archive_order":8,"of":21,"metrics":{"Curve":"-","Extreme Weather":"-","F1 (all)":"61.2","FPS (pytorch)":"-","Intersection":"-","Merge & Split":"-","Night":"-","Up & Down":"-"},"uses_additional_data":false},{"leaderboard":"/sota/3d-lane-detection-on-openlane","task":"3D Lane Detection","dataset":"OpenLane","model":"PETRv2-V (VoVNetV2)","rank_in_archive_order":11,"of":21,"metrics":{"Curve":"-","Extreme Weather":"-","F1 (all)":"57.8","FPS (pytorch)":"-","Intersection":"-","Merge & Split":"-","Night":"-","Up & Down":"-"},"uses_additional_data":false},{"leaderboard":"/sota/3d-lane-detection-on-openlane","task":"3D Lane Detection","dataset":"OpenLane","model":"PETRv2-E (EfficientNet)","rank_in_archive_order":17,"of":21,"metrics":{"Curve":"-","Extreme Weather":"-","F1 (all)":"51.9","FPS (pytorch)":"-","Intersection":"-","Merge & Split":"-","Night":"-","Up & Down":"-"},"uses_additional_data":false},{"leaderboard":"/sota/3d-object-detection-on-nuscenes-camera-only","task":"3D Object Detection","dataset":"nuScenes Camera Only","model":"PETRv2-pure","rank_in_archive_order":16,"of":19,"metrics":{"Future Frame":"false","NDS":"59.2"},"uses_additional_data":false},{"leaderboard":"/sota/bird-s-eye-view-semantic-segmentation-on","task":"Bird's-Eye View Semantic Segmentation","dataset":"nuScenes","model":"PETRv2","rank_in_archive_order":14,"of":17,"metrics":{"IoU lane - 224x480 - 100x100 at 0.5":"44.8"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2206.01256","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.01256"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/megvii-research/petr","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran_draft_wrong":1},"by_repo_kind":{},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"718ca707584a0928","entry":"pos2posemb3d","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"718ca707584a0928"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}