{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/isbnet-a-3d-point-cloud-instance-segmentation","title":"ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution","arxiv_id":"2303.00246","date":"2023-03-01","proceeding":"CVPR 2023 1","authors":["Tuan Duc Ngo","Binh-Son Hua","Khoi Nguyen"],"abstract":"Existing 3D instance segmentation methods are predominated by the bottom-up design -- manually fine-tuned algorithm to group points into clusters followed by a refinement network. However, by relying on the quality of the clusters, these methods generate susceptible results when (1) nearby objects with the same semantic class are packed together, or (2) large objects with loosely connected regions. To address these limitations, we introduce ISBNet, a novel cluster-free method that represents instances as kernels and decodes instance masks via dynamic convolution. To efficiently generate high-recall and discriminative kernels, we propose a simple strategy named Instance-aware Farthest Point Sampling to sample candidates and leverage the local aggregation layer inspired by PointNet++ to encode candidate features. Moreover, we show that predicting and leveraging the 3D axis-aligned bounding boxes in the dynamic convolution further boosts performance. Our method set new state-of-the-art results on ScanNetV2 (55.9), S3DIS (60.8), and STPLS3D (49.2) in terms of AP and retains fast inference time (237ms per scene on ScanNetV2). The source code and trained models are available at https://github.com/VinAIResearch/ISBNet.","url_abs":"https://arxiv.org/abs/2303.00246v2","url_pdf":"https://arxiv.org/pdf/2303.00246v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"isbnet-a-3d-point-cloud-instance-segmentation","repo_url":"https://github.com/VinAIResearch/ISBNet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"isbnet-a-3d-point-cloud-instance-segmentation","repo_url":"https://github.com/yunshin/SphericalMask","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"3d-instance-segmentation-1","task_name":"3D Instance Segmentation"},{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-instance-segmentation-on-s3dis","task":"3D Instance Segmentation","dataset":"S3DIS","model":"ISBNet","rank_in_archive_order":4,"of":21,"metrics":{"AP@50":"70.5","mAP":"60.8","mCov":"74.9","mPrec":"77.5","mRec":"77.1","mWCov":"76.8"},"uses_additional_data":true},{"leaderboard":"/sota/3d-instance-segmentation-on-stpls3d","task":"3D Instance Segmentation","dataset":"STPLS3D","model":"ISBNet","rank_in_archive_order":5,"of":9,"metrics":{"AP":"49.2","AP50":"64.0"},"uses_additional_data":false},{"leaderboard":"/sota/3d-instance-segmentation-on-scannetv2","task":"3D Instance Segmentation","dataset":"ScanNet(v2)","model":"ISBNet","rank_in_archive_order":9,"of":32,"metrics":{"mAP":"55.9","mAP @ 50":"76.3","mAP@25":"84.5"},"uses_additional_data":false},{"leaderboard":"/sota/3d-instance-segmentation-on-scannet200","task":"3D Instance Segmentation","dataset":"ScanNet200","model":"ISBNet","rank_in_archive_order":4,"of":5,"metrics":{"mAP":"24.5"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.00246","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.00246"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/VinAIResearch/ISBNet","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yunshin/SphericalMask","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_draft_wrong":2,"unverified":17},"by_repo_kind":{"official":{"samples":19,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"891b8ebab395921f","entry":"get_clones","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/blocks.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/blocks.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"891b8ebab395921f"}},{"code_sha256_prefix":"6ec42f54dda661e2","entry":"unique_with_inds","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/blocks.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/blocks.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6ec42f54dda661e2"}},{"code_sha256_prefix":"f117960158fe65f5","entry":"build_matcher","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/matcher.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/matcher.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"f117960158fe65f5"}},{"code_sha256_prefix":"560832d29481933a","entry":"calc_square_dist","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/model_utils.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/model_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"560832d29481933a"}},{"code_sha256_prefix":"606e2a02e1bda770","entry":"compute_dice_cost","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/matcher.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/matcher.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"606e2a02e1bda770"}},{"code_sha256_prefix":"878f5aebb430a0cd","entry":"compute_dice_loss","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/criterion.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/criterion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"878f5aebb430a0cd"}},{"code_sha256_prefix":"052d20023e79e3bf","entry":"compute_sigmoid_focal_loss","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/criterion.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/criterion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"052d20023e79e3bf"}},{"code_sha256_prefix":"b4cd600209f34611","entry":"evaluate_offset_mae","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/evaluation/point_wise_eval.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/evaluation/point_wise_eval.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"b4cd600209f34611"}},{"code_sha256_prefix":"caa556fdf3f1079e","entry":"evaluate_semantic_acc","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/evaluation/point_wise_eval.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/evaluation/point_wise_eval.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"caa556fdf3f1079e"}},{"code_sha256_prefix":"bc27be3c2a69fe70","entry":"evaluate_semantic_miou","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/evaluation/point_wise_eval.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/evaluation/point_wise_eval.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"bc27be3c2a69fe70"}},{"code_sha256_prefix":"d25a8a78b883dc85","entry":"get_iou","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/criterion.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/criterion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d25a8a78b883dc85"}},{"code_sha256_prefix":"083769d411d192ba","entry":"ln_norm","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/blocks.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/blocks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"083769d411d192ba"}},{"code_sha256_prefix":"1569c8cb19910d35","entry":"load_ids","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/evaluation/instance_eval_util.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/evaluation/instance_eval_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1569c8cb19910d35"}},{"code_sha256_prefix":"60642bb25404f38a","entry":"nms_and_merge","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/model_utils.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/model_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"60642bb25404f38a"}},{"code_sha256_prefix":"71b8cec4a388f189","entry":"read_mesh_vertices","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/evaluation/instance_eval_util.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/evaluation/instance_eval_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"71b8cec4a388f189"}},{"code_sha256_prefix":"0ad12b1e8408e2f9","entry":"set_bn_momentum_default","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/module_utils.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/module_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"0ad12b1e8408e2f9"}},{"code_sha256_prefix":"eaa1dc597251ce1b","entry":"sigmoid_bce_loss","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/matcher.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/matcher.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"eaa1dc597251ce1b"}},{"code_sha256_prefix":"ea0eed78ca52d7a8","entry":"standard_nms","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/model/model_utils.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/model/model_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"ea0eed78ca52d7a8"}},{"code_sha256_prefix":"d328ddb2e66ec4be","entry":"transform_points","repo":"VinAIResearch/ISBNet","repo_kind":"official","path":"isbnet/evaluation/instance_eval_util.py","file_url":"https://github.com/VinAIResearch/ISBNet/blob/HEAD/isbnet/evaluation/instance_eval_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d328ddb2e66ec4be"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}