{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/3d-object-detection-with-a-self-supervised","title":"3D Object Detection with a Self-supervised Lidar Scene Flow Backbone","arxiv_id":"2205.00705","date":"2022-05-02","proceeding":null,"authors":["Ekim Yurtsever","Emeç Erçelik","MingYu Liu","Zhijie Yang","Hanzhen Zhang","Pınar Topçam","Maximilian Listl","Yılmaz Kaan Çaylı","Alois Knoll"],"abstract":"State-of-the-art lidar-based 3D object detection methods rely on supervised learning and large labeled datasets. However, annotating lidar data is resource-consuming, and depending only on supervised learning limits the applicability of trained models. Self-supervised training strategies can alleviate these issues by learning a general point cloud backbone model for downstream 3D vision tasks. Against this backdrop, we show the relationship between self-supervised multi-frame flow representations and single-frame 3D detection hypotheses. Our main contribution leverages learned flow and motion representations and combines a self-supervised backbone with a supervised 3D detection head. First, a self-supervised scene flow estimation model is trained with cycle consistency. Then, the point cloud encoder of this model is used as the backbone of a single-frame 3D object detection head model. This second 3D object detection model learns to utilize motion representations to distinguish dynamic objects exhibiting different movement patterns. Experiments on KITTI and nuScenes benchmarks show that the proposed self-supervised pre-training increases 3D detection performance significantly. https://github.com/emecercelik/ssl-3d-detection.git","url_abs":"https://arxiv.org/abs/2205.00705v2","url_pdf":"https://arxiv.org/pdf/2205.00705v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"3d-object-detection-with-a-self-supervised","repo_url":"https://github.com/emecercelik/ssl-3d-detection","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"3d-object-detection-with-a-self-supervised","repo_url":"https://github.com/zhijie-yang/zhijie-yang.github.io","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"scene-flow-estimation","task_name":"Scene Flow Estimation"},{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"},{"task_slug":"self-supervised-scene-flow-estimation","task_name":"Self-supervised Scene Flow Estimation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2205.00705","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.00705"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/open-mmlab/mmdetection3d","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/WeijingShi/Point-GNN","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/HimangiM/Just-Go-with-the-Flow-Self-Supervised-Scene-Flow-Estimation","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/emecercelik/ssl-3d-detection","reach":{"status":"ok"}}],"summary":{"unverified":16},"by_repo_kind":{"found_in_text":{"samples":16,"ran":0,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a0172c48afaa4a94","entry":"average_gradients","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"util/tf_util.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/util/tf_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0172c48afaa4a94"}},{"code_sha256_prefix":"0141f393c163c9c5","entry":"box3d_to_cam_points","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"dataset/kitti_dataset.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/dataset/kitti_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0141f393c163c9c5"}},{"code_sha256_prefix":"7283711d920302c1","entry":"boxes_3d_to_corners","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/nms.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/nms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7283711d920302c1"}},{"code_sha256_prefix":"4855767c4a56c8c8","entry":"center_box_encoding","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/box_encoding.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/box_encoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4855767c4a56c8c8"}},{"code_sha256_prefix":"be80ed9b38980068","entry":"direct_box_decoding","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/box_encoding.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/box_encoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be80ed9b38980068"}},{"code_sha256_prefix":"9e3ebce01f03bd3d","entry":"direct_box_encoding","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/box_encoding.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/box_encoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e3ebce01f03bd3d"}},{"code_sha256_prefix":"ee3750781dc56c2b","entry":"downsample_by_average_voxel","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"dataset/kitti_dataset.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/dataset/kitti_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ee3750781dc56c2b"}},{"code_sha256_prefix":"384b9e6949fc0b72","entry":"downsample_by_random_voxel","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"dataset/kitti_dataset.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/dataset/kitti_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"384b9e6949fc0b72"}},{"code_sha256_prefix":"dce4ab6cd7b4540f","entry":"focal_loss_sigmoid","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/loss.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dce4ab6cd7b4540f"}},{"code_sha256_prefix":"9fc528f84f0af21b","entry":"focal_loss_softmax","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/loss.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9fc528f84f0af21b"}},{"code_sha256_prefix":"e1762f3d022bfacd","entry":"get_model_flow","repo":"HimangiM/Just-Go-with-the-Flow-Self-Supervised-Scene-Flow-Estimation","repo_kind":"found_in_text","path":"src/model_concat_upsa_cycle.py","file_url":"https://github.com/HimangiM/Just-Go-with-the-Flow-Self-Supervised-Scene-Flow-Estimation/blob/HEAD/src/model_concat_upsa_cycle.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"e1762f3d022bfacd"}},{"code_sha256_prefix":"cbc514a51f3ff453","entry":"instance_normalization","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/gnn.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/gnn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cbc514a51f3ff453"}},{"code_sha256_prefix":"434c5a9cd34a6dcc","entry":"load_config","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"util/config_util.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/util/config_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"434c5a9cd34a6dcc"}},{"code_sha256_prefix":"2df98c5f04b6fb17","entry":"load_train_config","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"util/config_util.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/util/config_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2df98c5f04b6fb17"}},{"code_sha256_prefix":"5794795650533553","entry":"multi_layer_downsampling_random","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/graph_gen.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/graph_gen.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5794795650533553"}},{"code_sha256_prefix":"487eda418ebb9106","entry":"overlapped_boxes_3d","repo":"WeijingShi/Point-GNN","repo_kind":"found_in_text","path":"models/nms.py","file_url":"https://github.com/WeijingShi/Point-GNN/blob/HEAD/models/nms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"487eda418ebb9106"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}