{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/m3d-rpn-monocular-3d-region-proposal-network","title":"M3D-RPN: Monocular 3D Region Proposal Network for Object Detection","arxiv_id":"1907.06038","date":"2019-07-13","proceeding":"ICCV 2019 10","authors":["Garrick Brazil","Xiaoming Liu"],"abstract":"Understanding the world in 3D is a critical component of urban autonomous driving. Generally, the combination of expensive LiDAR sensors and stereo RGB imaging has been paramount for successful 3D object detection algorithms, whereas monocular image-only methods experience drastically reduced performance. We propose to reduce the gap by reformulating the monocular 3D detection problem as a standalone 3D region proposal network. We leverage the geometric relationship of 2D and 3D perspectives, allowing 3D boxes to utilize well-known and powerful convolutional features generated in the image-space. To help address the strenuous 3D parameter estimations, we further design depth-aware convolutional layers which enable location specific feature development and in consequence improved 3D scene understanding. Compared to prior work in monocular 3D detection, our method consists of only the proposed 3D region proposal network rather than relying on external networks, data, or multiple stages. M3D-RPN is able to significantly improve the performance of both monocular 3D Object Detection and Bird's Eye View tasks within the KITTI urban autonomous driving dataset, while efficiently using a shared multi-class model.","url_abs":"https://arxiv.org/abs/1907.06038v2","url_pdf":"https://arxiv.org/pdf/1907.06038v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"m3d-rpn-monocular-3d-region-proposal-network","repo_url":"https://github.com/garrickbrazil/M3D-RPN","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"m3d-rpn-monocular-3d-region-proposal-network","repo_url":"https://github.com/JuliaChae/M3D-RPN-Waymo","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"m3d-rpn-monocular-3d-region-proposal-network","repo_url":"https://github.com/Nicholasli1995/EgoNet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"m3d-rpn-monocular-3d-region-proposal-network","repo_url":"https://github.com/abhi1kumar/M3D-RPN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"3d-object-detection-from-monocular-images","task_name":"3D Object Detection From Monocular Images"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"monocular-3d-object-detection","task_name":"Monocular 3D Object Detection"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"region-proposal","task_name":"Region Proposal"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"},{"task_slug":"vehicle-pose-estimation","task_name":"Vehicle Pose Estimation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-object-detection-on-rope3d","task":"3D Object Detection","dataset":"Rope3D","model":"M3D-RPN+(G)","rank_in_archive_order":7,"of":8,"metrics":{"AP@0.7":"16.75"},"uses_additional_data":false},{"leaderboard":"/sota/3d-object-detection-from-monocular-images-on-6","task":"3D Object Detection From Monocular Images","dataset":"Waymo Open Dataset","model":"M3D-RPN","rank_in_archive_order":3,"of":3,"metrics":{"3D mAPH Vehicle (Front Camera Only)":"0.65"},"uses_additional_data":false},{"leaderboard":"/sota/monocular-3d-object-detection-on-kitti-cars","task":"Monocular 3D Object Detection","dataset":"KITTI Cars Moderate","model":"M3D-RPN","rank_in_archive_order":25,"of":29,"metrics":{"AP Medium":"9.71"},"uses_additional_data":false},{"leaderboard":"/sota/vehicle-pose-estimation-on-kitti-cars-hard","task":"Vehicle Pose Estimation","dataset":"KITTI Cars Hard","model":"M3D-RPN","rank_in_archive_order":15,"of":19,"metrics":{"Average Orientation Similarity":"67.08"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1907.06038","atlas_url":"https://app.syntology.ai/?focus=1907.06038","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.06038"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/JuliaChae/M3D-RPN-Waymo","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Nicholasli1995/EgoNet","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/garrickbrazil/M3D-RPN","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/abhi1kumar/M3D-RPN","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"ran_fixture":1,"unverified":16},"by_repo_kind":{"official":{"samples":15,"ran":1,"repositories":1},"listed":{"samples":6,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"dd9fd89ee08ba7b7","entry":"get_frame_path","repo":"JuliaChae/M3D-RPN-Waymo","repo_kind":"listed","path":"eval/kitti_eval.py","file_url":"https://github.com/JuliaChae/M3D-RPN-Waymo/blob/HEAD/eval/kitti_eval.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd9fd89ee08ba7b7"}},{"code_sha256_prefix":"1dc11b0b2fb74958","entry":"get_image_index_str","repo":"JuliaChae/M3D-RPN-Waymo","repo_kind":"listed","path":"eval/kitti_common.py","file_url":"https://github.com/JuliaChae/M3D-RPN-Waymo/blob/HEAD/eval/kitti_common.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1dc11b0b2fb74958"}},{"code_sha256_prefix":"36f5f743192471d9","entry":"get_image_path","repo":"JuliaChae/M3D-RPN-Waymo","repo_kind":"listed","path":"eval/kitti_common.py","file_url":"https://github.com/JuliaChae/M3D-RPN-Waymo/blob/HEAD/eval/kitti_common.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"36f5f743192471d9"}},{"code_sha256_prefix":"5502a789c2da0e5e","entry":"py_cpu_nms","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/nms/py_cpu_nms.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/nms/py_cpu_nms.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5502a789c2da0e5e"}},{"code_sha256_prefix":"1629055176e9c1ba","entry":"read_waymo_label","repo":"JuliaChae/M3D-RPN-Waymo","repo_kind":"listed","path":"lib/waymo_imdb_util.py","file_url":"https://github.com/JuliaChae/M3D-RPN-Waymo/blob/HEAD/lib/waymo_imdb_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1629055176e9c1ba"}},{"code_sha256_prefix":"1f9619e12d3bd0b1","entry":"absolute_import","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1f9619e12d3bd0b1"}},{"code_sha256_prefix":"86a6965b9bf27579","entry":"anchor_center","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/rpn_util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/rpn_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"86a6965b9bf27579"}},{"code_sha256_prefix":"1c47eb3c9a5da30c","entry":"build","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"models/densenet121_3d_dilate.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/models/densenet121_3d_dilate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c47eb3c9a5da30c"}},{"code_sha256_prefix":"2e3da10ee5eae517","entry":"build","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"models/densenet121_3d_dilate_depth_aware.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/models/densenet121_3d_dilate_depth_aware.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2e3da10ee5eae517"}},{"code_sha256_prefix":"1469325b29d17885","entry":"cluster_anchors","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/rpn_util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/rpn_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1469325b29d17885"}},{"code_sha256_prefix":"7f925af944ec63a0","entry":"compute_targets","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/rpn_util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/rpn_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f925af944ec63a0"}},{"code_sha256_prefix":"5c106ea84838b5a0","entry":"get_kitti_info_path","repo":"JuliaChae/M3D-RPN-Waymo","repo_kind":"listed","path":"eval/kitti_common.py","file_url":"https://github.com/JuliaChae/M3D-RPN-Waymo/blob/HEAD/eval/kitti_common.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5c106ea84838b5a0"}},{"code_sha256_prefix":"241163a78260b639","entry":"init_config","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/core.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"241163a78260b639"}},{"code_sha256_prefix":"992842247d4e98e5","entry":"init_log_file","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"992842247d4e98e5"}},{"code_sha256_prefix":"b5c639f7e9d994b4","entry":"init_training_model","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/core.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b5c639f7e9d994b4"}},{"code_sha256_prefix":"e214e5ed10c86a42","entry":"intersect","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/core.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e214e5ed10c86a42"}},{"code_sha256_prefix":"aacaef36624e2635","entry":"pretty_print","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aacaef36624e2635"}},{"code_sha256_prefix":"94692e33979fd4e6","entry":"read_kitti_cal","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/imdb_util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/imdb_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"94692e33979fd4e6"}},{"code_sha256_prefix":"4d197b1fa08418dd","entry":"read_kitti_label","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/imdb_util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/imdb_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4d197b1fa08418dd"}},{"code_sha256_prefix":"09bdf9f5b1f17bb7","entry":"read_kitti_poses","repo":"garrickbrazil/M3D-RPN","repo_kind":"official","path":"lib/imdb_util.py","file_url":"https://github.com/garrickbrazil/M3D-RPN/blob/HEAD/lib/imdb_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09bdf9f5b1f17bb7"}},{"code_sha256_prefix":"2f75951e005a412e","entry":"read_waymo_cal","repo":"JuliaChae/M3D-RPN-Waymo","repo_kind":"listed","path":"lib/waymo_imdb_util.py","file_url":"https://github.com/JuliaChae/M3D-RPN-Waymo/blob/HEAD/lib/waymo_imdb_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2f75951e005a412e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}