{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/rtm3d-real-time-monocular-3d-detection-from","title":"RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving","arxiv_id":"2001.03343","date":"2020-01-10","proceeding":"ECCV 2020 8","authors":["Peixuan Li","Huaici Zhao","PengFei Liu","Feidao Cao"],"abstract":"In this work, we propose an efficient and accurate monocular 3D detection framework in single shot. Most successful 3D detectors take the projection constraint from the 3D bounding box to the 2D box as an important component. Four edges of a 2D box provide only four constraints and the performance deteriorates dramatically with the small error of the 2D detector. Different from these approaches, our method predicts the nine perspective keypoints of a 3D bounding box in image space, and then utilize the geometric relationship of 3D and 2D perspectives to recover the dimension, location, and orientation in 3D space. In this method, the properties of the object can be predicted stably even when the estimation of keypoints is very noisy, which enables us to obtain fast detection speed with a small architecture. Training our method only uses the 3D properties of the object without the need for external networks or supervision data. Our method is the first real-time system for monocular image 3D detection while achieves state-of-the-art performance on the KITTI benchmark. Code will be released at https://github.com/Banconxuan/RTM3D.","url_abs":"https://arxiv.org/abs/2001.03343v1","url_pdf":"https://arxiv.org/pdf/2001.03343v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"rtm3d-real-time-monocular-3d-detection-from","repo_url":"https://github.com/Banconxuan/RTM3D","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"rtm3d-real-time-monocular-3d-detection-from","repo_url":"https://github.com/maudzung/RTM3D","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"vehicle-pose-estimation","task_name":"Vehicle Pose Estimation"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/vehicle-pose-estimation-on-kitti-cars-hard","task":"Vehicle Pose Estimation","dataset":"KITTI Cars Hard","model":"RTM-3D","rank_in_archive_order":6,"of":19,"metrics":{"Average Orientation Similarity":"77.18"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2001.03343","atlas_url":"https://app.syntology.ai/?focus=2001.03343","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2001.03343"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Banconxuan/RTM3D","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/maudzung/RTM3D","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":3,"ran":5,"ran_honours":3,"unverified":5},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1},"listed":{"samples":13,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"65d7a40d70c53ed9","entry":"compute_bin_loss","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/losses/losses.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/losses/losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65d7a40d70c53ed9"}},{"code_sha256_prefix":"480409d49471d790","entry":"compute_box_3d","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/data_process/kitti_data_utils.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/data_process/kitti_data_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"480409d49471d790"}},{"code_sha256_prefix":"7df13fb9e54d592b","entry":"compute_res_loss","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/losses/losses.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/losses/losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7df13fb9e54d592b"}},{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/models/fpn_resnet.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/models/fpn_resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"f1dbc18e2080c03e","entry":"get_alpha","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/utils/evaluation_utils.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/utils/evaluation_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f1dbc18e2080c03e"}},{"code_sha256_prefix":"7bf982cd2568c239","entry":"get_num_parameters","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/models/model_utils.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/models/model_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7bf982cd2568c239"}},{"code_sha256_prefix":"80a8f885a0f16ba6","entry":"get_pred_depth","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/utils/evaluation_utils.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/utils/evaluation_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80a8f885a0f16ba6"}},{"code_sha256_prefix":"de329cc98c9f786d","entry":"read_clib","repo":"Banconxuan/RTM3D","repo_kind":"official","path":"src/tools/kitti.py","file_url":"https://github.com/Banconxuan/RTM3D/blob/HEAD/src/tools/kitti.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de329cc98c9f786d"}},{"code_sha256_prefix":"9daaaaf61eccf5c9","entry":"read_clib0","repo":"Banconxuan/RTM3D","repo_kind":"official","path":"src/tools/kitti.py","file_url":"https://github.com/Banconxuan/RTM3D/blob/HEAD/src/tools/kitti.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9daaaaf61eccf5c9"}},{"code_sha256_prefix":"3252b60b8cec216a","entry":"read_clib3","repo":"Banconxuan/RTM3D","repo_kind":"official","path":"src/tools/kitti.py","file_url":"https://github.com/Banconxuan/RTM3D/blob/HEAD/src/tools/kitti.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3252b60b8cec216a"}},{"code_sha256_prefix":"f83dc76e5a02776d","entry":"roty","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/data_process/kitti_data_utils.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/data_process/kitti_data_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f83dc76e5a02776d"}},{"code_sha256_prefix":"9d749234d255406c","entry":"compute_rot_loss","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/losses/losses.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/losses/losses.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9d749234d255406c"}},{"code_sha256_prefix":"53da3f0e2c240363","entry":"get_pose_net","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/models/fpn_resnet.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/models/fpn_resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53da3f0e2c240363"}},{"code_sha256_prefix":"da3cdf1c124aa18f","entry":"get_pose_net","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/models/resnet.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/models/resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da3cdf1c124aa18f"}},{"code_sha256_prefix":"cbb1e79cf3f516f7","entry":"make_data_parallel","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/models/model_utils.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/models/model_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cbb1e79cf3f516f7"}},{"code_sha256_prefix":"296d581d9aac4538","entry":"rtm3d_decode","repo":"maudzung/RTM3D","repo_kind":"listed","path":"src/utils/evaluation_utils.py","file_url":"https://github.com/maudzung/RTM3D/blob/HEAD/src/utils/evaluation_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"296d581d9aac4538"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}