{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/centersnap-single-shot-multi-object-3d-shape","title":"CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation","arxiv_id":"2203.01929","date":"2022-03-03","proceeding":null,"authors":["Muhammad Zubair Irshad","Thomas Kollar","Michael Laskey","Kevin Stone","Zsolt Kira"],"abstract":"This paper studies the complex task of simultaneous multi-object 3D reconstruction, 6D pose and size estimation from a single-view RGB-D observation. In contrast to instance-level pose estimation, we focus on a more challenging problem where CAD models are not available at inference time. Existing approaches mainly follow a complex multi-stage pipeline which first localizes and detects each object instance in the image and then regresses to either their 3D meshes or 6D poses. These approaches suffer from high-computational cost and low performance in complex multi-object scenarios, where occlusions can be present. Hence, we present a simple one-stage approach to predict both the 3D shape and estimate the 6D pose and size jointly in a bounding-box free manner. In particular, our method treats object instances as spatial centers where each center denotes the complete shape of an object along with its 6D pose and size. Through this per-pixel representation, our approach can reconstruct in real-time (40 FPS) multiple novel object instances and predict their 6D pose and sizes in a single-forward pass. Through extensive experiments, we demonstrate that our approach significantly outperforms all shape completion and categorical 6D pose and size estimation baselines on multi-object ShapeNet and NOCS datasets respectively with a 12.6% absolute improvement in mAP for 6D pose for novel real-world object instances.","url_abs":"https://arxiv.org/abs/2203.01929v1","url_pdf":"https://arxiv.org/pdf/2203.01929v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"centersnap-single-shot-multi-object-3d-shape","repo_url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"centersnap-single-shot-multi-object-3d-shape","repo_url":"https://github.com/zubair-irshad/CenterSnap","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"centersnap-single-shot-multi-object-3d-shape","repo_url":"https://github.com/zubair-irshad/shapo","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"3d-shape-reconstruction","task_name":"3D Shape Reconstruction"},{"task_slug":"6d-pose-estimation-1","task_name":"6D Pose Estimation"},{"task_slug":"6d-pose-estimation-using-rgbd","task_name":"6D Pose Estimation using RGBD"},{"task_slug":"object","task_name":"Object"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/6d-pose-estimation-using-rgbd-on-camera25","task":"6D Pose Estimation using RGBD","dataset":"CAMERA25","model":"CenterSnap","rank_in_archive_order":1,"of":2,"metrics":{"mAP 10, 10cm":"87.9 ","mAP 10, 5cm":"81.3","mAP 3DIou@25":"93.2","mAP 3DIou@50":"92.5","mAP 5, 5cm":"66.2"},"uses_additional_data":false},{"leaderboard":"/sota/6d-pose-estimation-using-rgbd-on-real275","task":"6D Pose Estimation using RGBD","dataset":"REAL275","model":"CenterSnap","rank_in_archive_order":6,"of":11,"metrics":{"mAP 10, 10cm":"70.9","mAP 10, 5cm":"64.3","mAP 3DIou@25":"83.5","mAP 3DIou@50":"80.2","mAP 5, 5cm":"29.1"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.01929","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.01929"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zubair-irshad/shapo","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zubair-irshad/CenterSnap","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":6},"by_repo_kind":{"listed":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"764464f2d8106e6f","entry":"find_nearest","repo":"ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","repo_kind":"listed","path":"centersnap/original_repo_utils.py","file_url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation/blob/HEAD/centersnap/original_repo_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"764464f2d8106e6f"}},{"code_sha256_prefix":"ca690ba16e15b33f","entry":"load_depth","repo":"ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","repo_kind":"listed","path":"centersnap/original_repo_utils.py","file_url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation/blob/HEAD/centersnap/original_repo_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ca690ba16e15b33f"}},{"code_sha256_prefix":"51f292b82765ad00","entry":"load_img_NOCS","repo":"ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","repo_kind":"listed","path":"centersnap/original_repo_utils.py","file_url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation/blob/HEAD/centersnap/original_repo_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"51f292b82765ad00"}},{"code_sha256_prefix":"53a8f0aaf57b55e2","entry":"util_draw_depth","repo":"ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","repo_kind":"listed","path":"centersnap/utils.py","file_url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation/blob/HEAD/centersnap/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53a8f0aaf57b55e2"}},{"code_sha256_prefix":"11111697e33271a6","entry":"util_draw_heatmap","repo":"ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","repo_kind":"listed","path":"centersnap/utils.py","file_url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation/blob/HEAD/centersnap/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"11111697e33271a6"}},{"code_sha256_prefix":"5cbc747bda4b298b","entry":"util_draw_seg","repo":"ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation","repo_kind":"listed","path":"centersnap/utils.py","file_url":"https://github.com/ibaiGorordo/ONNX-CenterSnap-6D-Pose-and-Shape-Estimation/blob/HEAD/centersnap/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5cbc747bda4b298b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}