{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/desire-gs-4d-street-gaussians-for-static","title":"DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenes","arxiv_id":"2411.11921","date":"2024-11-18","proceeding":"CVPR 2025 1","authors":["Chensheng Peng","Chengwei Zhang","Yixiao Wang","Chenfeng Xu","Yichen Xie","Wenzhao Zheng","Kurt Keutzer","Masayoshi Tomizuka","Wei Zhan"],"abstract":"We present DeSiRe-GS, a self-supervised gaussian splatting representation, enabling effective static-dynamic decomposition and high-fidelity surface reconstruction in complex driving scenarios. Our approach employs a two-stage optimization pipeline of dynamic street Gaussians. In the first stage, we extract 2D motion masks based on the observation that 3D Gaussian Splatting inherently can reconstruct only the static regions in dynamic environments. These extracted 2D motion priors are then mapped into the Gaussian space in a differentiable manner, leveraging an efficient formulation of dynamic Gaussians in the second stage. Combined with the introduced geometric regularizations, our method are able to address the over-fitting issues caused by data sparsity in autonomous driving, reconstructing physically plausible Gaussians that align with object surfaces rather than floating in air. Furthermore, we introduce temporal cross-view consistency to ensure coherence across time and viewpoints, resulting in high-quality surface reconstruction. Comprehensive experiments demonstrate the efficiency and effectiveness of DeSiRe-GS, surpassing prior self-supervised arts and achieving accuracy comparable to methods relying on external 3D bounding box annotations. Code is available at \\url{https://github.com/chengweialan/DeSiRe-GS}","url_abs":"https://arxiv.org/abs/2411.11921v1","url_pdf":"https://arxiv.org/pdf/2411.11921v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"desire-gs-4d-street-gaussians-for-static","repo_url":"https://github.com/chengweialan/desire-gs","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"surface-reconstruction","task_name":"Surface Reconstruction"}],"methods":[{"method_slug":"align","method_name":"ALIGN"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2411.11921","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2411.11921"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chengweialan/desire-gs","reach":{"status":"ok"}}],"summary":{"ran_honours":2,"ran":1,"unverified":6},"by_repo_kind":{"official":{"samples":9,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"6154e3744ece5728","entry":"create_window","repo":"chengweialan/desire-gs","repo_kind":"official","path":"utils/loss_utils.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6154e3744ece5728"}},{"code_sha256_prefix":"c56b7ef16f309a45","entry":"gaussian","repo":"chengweialan/desire-gs","repo_kind":"official","path":"utils/loss_utils.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c56b7ef16f309a45"}},{"code_sha256_prefix":"1dab900b2adbe38e","entry":"normalize_activation","repo":"chengweialan/desire-gs","repo_kind":"official","path":"lpipsPyTorch/modules/utils.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/lpipsPyTorch/modules/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1dab900b2adbe38e"}},{"code_sha256_prefix":"14176c74041759fd","entry":"assert_not_none","repo":"chengweialan/desire-gs","repo_kind":"official","path":"scene/dynamic_model.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/scene/dynamic_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"14176c74041759fd"}},{"code_sha256_prefix":"ecb5cdbebd94ef38","entry":"camera_project","repo":"chengweialan/desire-gs","repo_kind":"official","path":"scene/dynamic_model.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/scene/dynamic_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ecb5cdbebd94ef38"}},{"code_sha256_prefix":"aae353a107ad40dc","entry":"convert_image_dtype","repo":"chengweialan/desire-gs","repo_kind":"official","path":"scene/dynamic_model.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/scene/dynamic_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"aae353a107ad40dc"}},{"code_sha256_prefix":"07bd0da29c4dc7bb","entry":"get_network","repo":"chengweialan/desire-gs","repo_kind":"official","path":"lpipsPyTorch/modules/networks.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/lpipsPyTorch/modules/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"07bd0da29c4dc7bb"}},{"code_sha256_prefix":"b06f27c08cf5d0ca","entry":"get_state_dict","repo":"chengweialan/desire-gs","repo_kind":"official","path":"lpipsPyTorch/modules/utils.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/lpipsPyTorch/modules/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b06f27c08cf5d0ca"}},{"code_sha256_prefix":"52847426a3ea775e","entry":"psnr","repo":"chengweialan/desire-gs","repo_kind":"official","path":"utils/loss_utils.py","file_url":"https://github.com/chengweialan/desire-gs/blob/HEAD/utils/loss_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"52847426a3ea775e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}