{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sparse-fuse-dense-towards-high-quality-3d-1","title":"Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completion","arxiv_id":"2203.09780","date":"2022-03-18","proceeding":"CVPR 2022 1","authors":["Xiaopei Wu","Liang Peng","Honghui Yang","Liang Xie","Chenxi Huang","Chengqi Deng","Haifeng Liu","Deng Cai"],"abstract":"Current LiDAR-only 3D detection methods inevitably suffer from the sparsity of point clouds. Many multi-modal methods are proposed to alleviate this issue, while different representations of images and point clouds make it difficult to fuse them, resulting in suboptimal performance. In this paper, we present a novel multi-modal framework SFD (Sparse Fuse Dense), which utilizes pseudo point clouds generated from depth completion to tackle the issues mentioned above. Different from prior works, we propose a new RoI fusion strategy 3D-GAF (3D Grid-wise Attentive Fusion) to make fuller use of information from different types of point clouds. Specifically, 3D-GAF fuses 3D RoI features from the couple of point clouds in a grid-wise attentive way, which is more fine-grained and more precise. In addition, we propose a SynAugment (Synchronized Augmentation) to enable our multi-modal framework to utilize all data augmentation approaches tailored to LiDAR-only methods. Lastly, we customize an effective and efficient feature extractor CPConv (Color Point Convolution) for pseudo point clouds. It can explore 2D image features and 3D geometric features of pseudo point clouds simultaneously. Our method holds the highest entry on the KITTI car 3D object detection leaderboard, demonstrating the effectiveness of our SFD. Codes are available at https://github.com/LittlePey/SFD.","url_abs":"https://arxiv.org/abs/2203.09780v2","url_pdf":"https://arxiv.org/pdf/2203.09780v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sparse-fuse-dense-towards-high-quality-3d-1","repo_url":"https://github.com/LittlePey/SFD","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"depth-completion","task_name":"Depth Completion"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"high","task_name":"Vocal Bursts Intensity Prediction"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2203.09780","atlas_url":"https://app.syntology.ai/?focus=2203.09780","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.09780"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/LittlePey/SFD","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_draft_wrong":1,"ran":4,"unverified":8},"by_repo_kind":{"official":{"samples":13,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"47397a2377a470c7","entry":"get_lidar_in_image_fov","repo":"LittlePey/SFD","repo_kind":"official","path":"kitti_object.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/kitti_object.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"47397a2377a470c7"}},{"code_sha256_prefix":"aa16fbdd4a5afcf1","entry":"random_flip_along_y","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/datasets/augmentor/augmentor_utils_sfd.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/datasets/augmentor/augmentor_utils_sfd.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aa16fbdd4a5afcf1"}},{"code_sha256_prefix":"8843d80ab666c4e9","entry":"rotx","repo":"LittlePey/SFD","repo_kind":"official","path":"kitti_util.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/kitti_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8843d80ab666c4e9"}},{"code_sha256_prefix":"ae86074e10e1dfd7","entry":"roty","repo":"LittlePey/SFD","repo_kind":"official","path":"kitti_util.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/kitti_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ae86074e10e1dfd7"}},{"code_sha256_prefix":"082920adf6e29c94","entry":"rotz","repo":"LittlePey/SFD","repo_kind":"official","path":"kitti_util.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/kitti_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"082920adf6e29c94"}},{"code_sha256_prefix":"696fe155f9990d38","entry":"cfg_from_yaml_file","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/config.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"696fe155f9990d38"}},{"code_sha256_prefix":"40c0b7bcfe33fd6d","entry":"depth_read","repo":"LittlePey/SFD","repo_kind":"official","path":"depth_to_lidar.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/depth_to_lidar.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"40c0b7bcfe33fd6d"}},{"code_sha256_prefix":"1780d388cc532a6d","entry":"get_corner_loss_lidar","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/utils/loss_utils.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1780d388cc532a6d"}},{"code_sha256_prefix":"269fcc858076aa5f","entry":"get_global_grid_points_of_roi","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/utils/loss_utils.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"269fcc858076aa5f"}},{"code_sha256_prefix":"f133fe553902b4ff","entry":"get_gridify_iou3d_loss","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/utils/loss_utils.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f133fe553902b4ff"}},{"code_sha256_prefix":"79d4891f6b00a1cd","entry":"global_rotation","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/datasets/augmentor/augmentor_utils_sfd.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/datasets/augmentor/augmentor_utils_sfd.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"79d4891f6b00a1cd"}},{"code_sha256_prefix":"392c0cf3a1b07b12","entry":"merge_new_config","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/config.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"392c0cf3a1b07b12"}},{"code_sha256_prefix":"00692f8182ba51ca","entry":"random_flip_along_x","repo":"LittlePey/SFD","repo_kind":"official","path":"pcdet/datasets/augmentor/augmentor_utils_sfd.py","file_url":"https://github.com/LittlePey/SFD/blob/HEAD/pcdet/datasets/augmentor/augmentor_utils_sfd.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"00692f8182ba51ca"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}