{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/end-to-end-pseudo-lidar-for-image-based-3d","title":"End-to-End Pseudo-LiDAR for Image-Based 3D Object Detection","arxiv_id":"2004.03080","date":"2020-04-07","proceeding":"CVPR 2020 6","authors":["Rui Qian","Divyansh Garg","Yan Wang","Yurong You","Serge Belongie","Bharath Hariharan","Mark Campbell","Kilian Q. Weinberger","Wei-Lun Chao"],"abstract":"Reliable and accurate 3D object detection is a necessity for safe autonomous driving. Although LiDAR sensors can provide accurate 3D point cloud estimates of the environment, they are also prohibitively expensive for many settings. Recently, the introduction of pseudo-LiDAR (PL) has led to a drastic reduction in the accuracy gap between methods based on LiDAR sensors and those based on cheap stereo cameras. PL combines state-of-the-art deep neural networks for 3D depth estimation with those for 3D object detection by converting 2D depth map outputs to 3D point cloud inputs. However, so far these two networks have to be trained separately. In this paper, we introduce a new framework based on differentiable Change of Representation (CoR) modules that allow the entire PL pipeline to be trained end-to-end. The resulting framework is compatible with most state-of-the-art networks for both tasks and in combination with PointRCNN improves over PL consistently across all benchmarks -- yielding the highest entry on the KITTI image-based 3D object detection leaderboard at the time of submission. Our code will be made available at https://github.com/mileyan/pseudo-LiDAR_e2e.","url_abs":"https://arxiv.org/abs/2004.03080v2","url_pdf":"https://arxiv.org/pdf/2004.03080v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"end-to-end-pseudo-lidar-for-image-based-3d","repo_url":"https://github.com/mileyan/pseudo-LiDAR_e2e","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-depth-estimation","task_name":"3D Depth Estimation"},{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"depth-estimation","task_name":"Depth Estimation"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2004.03080","atlas_url":"https://app.syntology.ai/?focus=2004.03080","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.03080"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mileyan/pseudo-LiDAR_e2e","reach":null}],"summary":{"ran_draft_wrong":3,"ran_honours":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"0cdfd9167825b209","entry":"compute_loss","repo":"mileyan/pseudo-LiDAR_e2e","repo_kind":"official","path":"PIXOR/train_pixor_e2e.py","file_url":"https://github.com/mileyan/pseudo-LiDAR_e2e/blob/HEAD/PIXOR/train_pixor_e2e.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0cdfd9167825b209"}},{"code_sha256_prefix":"c349bc6f8ed16220","entry":"create_logger","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"c349bc6f8ed16220"}},{"code_sha256_prefix":"452d196e9b42108b","entry":"forward","repo":"mileyan/pseudo-LiDAR_e2e","repo_kind":"official","path":"PIXOR/train_pixor_e2e.py","file_url":"https://github.com/mileyan/pseudo-LiDAR_e2e/blob/HEAD/PIXOR/train_pixor_e2e.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"452d196e9b42108b"}},{"code_sha256_prefix":"c923cdba00c4aef3","entry":"get_grid_2D","repo":"mileyan/pseudo-LiDAR_e2e","repo_kind":"official","path":"PIXOR/train_pixor_e2e.py","file_url":"https://github.com/mileyan/pseudo-LiDAR_e2e/blob/HEAD/PIXOR/train_pixor_e2e.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c923cdba00c4aef3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}