{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mononerd-nerf-like-representations-for","title":"MonoNeRD: NeRF-like Representations for Monocular 3D Object Detection","arxiv_id":"2308.09421","date":"2023-08-18","proceeding":"ICCV 2023 1","authors":["Junkai Xu","Liang Peng","Haoran Cheng","Hao Li","Wei Qian","Ke Li","Wenxiao Wang","Deng Cai"],"abstract":"In the field of monocular 3D detection, it is common practice to utilize scene geometric clues to enhance the detector's performance. However, many existing works adopt these clues explicitly such as estimating a depth map and back-projecting it into 3D space. This explicit methodology induces sparsity in 3D representations due to the increased dimensionality from 2D to 3D, and leads to substantial information loss, especially for distant and occluded objects. To alleviate this issue, we propose MonoNeRD, a novel detection framework that can infer dense 3D geometry and occupancy. Specifically, we model scenes with Signed Distance Functions (SDF), facilitating the production of dense 3D representations. We treat these representations as Neural Radiance Fields (NeRF) and then employ volume rendering to recover RGB images and depth maps. To the best of our knowledge, this work is the first to introduce volume rendering for M3D, and demonstrates the potential of implicit reconstruction for image-based 3D perception. Extensive experiments conducted on the KITTI-3D benchmark and Waymo Open Dataset demonstrate the effectiveness of MonoNeRD. Codes are available at https://github.com/cskkxjk/MonoNeRD.","url_abs":"https://arxiv.org/abs/2308.09421v2","url_pdf":"https://arxiv.org/pdf/2308.09421v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mononerd-nerf-like-representations-for","repo_url":"https://github.com/cskkxjk/mononerd","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-object-detection","task_name":"3D Object Detection"},{"task_slug":"3d-geometry","task_name":"3D geometry"},{"task_slug":"monocular-3d-object-detection","task_name":"Monocular 3D Object Detection"},{"task_slug":"nerf","task_name":"NeRF"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.09421","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.09421"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cskkxjk/mononerd","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/cskkxjk/MonoNeRD","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":6,"unverified":3},"by_repo_kind":{"official":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"576fc9a704db460c","entry":"convbn","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/models/backbones_3d_mono/submodule.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/models/backbones_3d_mono/submodule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"576fc9a704db460c"}},{"code_sha256_prefix":"480bf7306505e398","entry":"convbn_3d","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/models/backbones_3d_mono/submodule.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/models/backbones_3d_mono/submodule.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"480bf7306505e398"}},{"code_sha256_prefix":"9bf9664ed0d2c987","entry":"edge_aware_loss_v2","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/utils/edge_aware_loss.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/utils/edge_aware_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9bf9664ed0d2c987"}},{"code_sha256_prefix":"a5a2d3ad76c124dc","entry":"project_pseudo_lidar_to_rectcam","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/models/backbones_3d_mono/mononerd_backbone.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/models/backbones_3d_mono/mononerd_backbone.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5a2d3ad76c124dc"}},{"code_sha256_prefix":"0eba74216c48c279","entry":"project_rect_to_image","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/models/backbones_3d_mono/mononerd_backbone.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/models/backbones_3d_mono/mononerd_backbone.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0eba74216c48c279"}},{"code_sha256_prefix":"370605cfbaea4721","entry":"project_rectcam_to_pseudo_lidar","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/models/backbones_3d_mono/mononerd_backbone.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/models/backbones_3d_mono/mononerd_backbone.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"370605cfbaea4721"}},{"code_sha256_prefix":"696fe155f9990d38","entry":"cfg_from_yaml_file","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/config.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"696fe155f9990d38"}},{"code_sha256_prefix":"8a7cbf962b631fa2","entry":"get_corner_loss_lidar","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/utils/loss_utils.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/utils/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a7cbf962b631fa2"}},{"code_sha256_prefix":"392c0cf3a1b07b12","entry":"merge_new_config","repo":"cskkxjk/MonoNeRD","repo_kind":"official","path":"mononerd/config.py","file_url":"https://github.com/cskkxjk/MonoNeRD/blob/HEAD/mononerd/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"392c0cf3a1b07b12"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}