{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sparsedrive-end-to-end-autonomous-driving-via","title":"SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation","arxiv_id":"2405.19620","date":"2024-05-30","proceeding":null,"authors":["Wenchao Sun","Xuewu Lin","Yining Shi","Chuang Zhang","Haoran Wu","Sifa Zheng"],"abstract":"The well-established modular autonomous driving system is decoupled into different standalone tasks, e.g. perception, prediction and planning, suffering from information loss and error accumulation across modules. In contrast, end-to-end paradigms unify multi-tasks into a fully differentiable framework, allowing for optimization in a planning-oriented spirit. Despite the great potential of end-to-end paradigms, both the performance and efficiency of existing methods are not satisfactory, particularly in terms of planning safety. We attribute this to the computationally expensive BEV (bird's eye view) features and the straightforward design for prediction and planning. To this end, we explore the sparse representation and review the task design for end-to-end autonomous driving, proposing a new paradigm named SparseDrive. Concretely, SparseDrive consists of a symmetric sparse perception module and a parallel motion planner. The sparse perception module unifies detection, tracking and online mapping with a symmetric model architecture, learning a fully sparse representation of the driving scene. For motion prediction and planning, we review the great similarity between these two tasks, leading to a parallel design for motion planner. Based on this parallel design, which models planning as a multi-modal problem, we propose a hierarchical planning selection strategy , which incorporates a collision-aware rescore module, to select a rational and safe trajectory as the final planning output. With such effective designs, SparseDrive surpasses previous state-of-the-arts by a large margin in performance of all tasks, while achieving much higher training and inference efficiency. Code will be avaliable at https://github.com/swc-17/SparseDrive for facilitating future research.","url_abs":"https://arxiv.org/abs/2405.19620v2","url_pdf":"https://arxiv.org/pdf/2405.19620v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sparsedrive-end-to-end-autonomous-driving-via","repo_url":"https://github.com/swc-17/sparsedrive","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"sparsedrive-end-to-end-autonomous-driving-via","repo_url":"https://github.com/linxuewu/sparse4d","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"bench2drive","task_name":"Bench2Drive"},{"task_slug":"motion-prediction","task_name":"motion prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/bench2drive-on-bench2drive","task":"Bench2Drive","dataset":"Bench2Drive","model":"SparseDrive","rank_in_archive_order":29,"of":35,"metrics":{"Driving Score":"44.54"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2405.19620","atlas_url":"https://app.syntology.ai/?focus=2405.19620","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.19620"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/swc-17/sparsedrive","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/linxuewu/sparse4d","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":2},"by_repo_kind":{"official":{"samples":1,"ran":0,"repositories":1},"listed":{"samples":1,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"69b46d10e8114cc4","entry":"gen_sineembed_for_position","repo":"swc-17/sparsedrive","repo_kind":"official","path":"projects/mmdet3d_plugin/models/attention.py","file_url":"https://github.com/swc-17/sparsedrive/blob/HEAD/projects/mmdet3d_plugin/models/attention.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"69b46d10e8114cc4"}},{"code_sha256_prefix":"82c79d0ad5cc7f82","entry":"topk","repo":"linxuewu/sparse4d","repo_kind":"listed","path":"projects/mmdet3d_plugin/models/instance_bank.py","file_url":"https://github.com/linxuewu/sparse4d/blob/HEAD/projects/mmdet3d_plugin/models/instance_bank.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82c79d0ad5cc7f82"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}