{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cpcm-contextual-point-cloud-modeling-for","title":"CPCM: Contextual Point Cloud Modeling for Weakly-supervised Point Cloud Semantic Segmentation","arxiv_id":"2307.10316","date":"2023-07-19","proceeding":"ICCV 2023 1","authors":["Lizhao Liu","Zhuangwei Zhuang","Shangxin Huang","Xunlong Xiao","Tianhang Xiang","Cen Chen","Jingdong Wang","Mingkui Tan"],"abstract":"We study the task of weakly-supervised point cloud semantic segmentation with sparse annotations (e.g., less than 0.1% points are labeled), aiming to reduce the expensive cost of dense annotations. Unfortunately, with extremely sparse annotated points, it is very difficult to extract both contextual and object information for scene understanding such as semantic segmentation. Motivated by masked modeling (e.g., MAE) in image and video representation learning, we seek to endow the power of masked modeling to learn contextual information from sparsely-annotated points. However, directly applying MAE to 3D point clouds with sparse annotations may fail to work. First, it is nontrivial to effectively mask out the informative visual context from 3D point clouds. Second, how to fully exploit the sparse annotations for context modeling remains an open question. In this paper, we propose a simple yet effective Contextual Point Cloud Modeling (CPCM) method that consists of two parts: a region-wise masking (RegionMask) strategy and a contextual masked training (CMT) method. Specifically, RegionMask masks the point cloud continuously in geometric space to construct a meaningful masked prediction task for subsequent context learning. CMT disentangles the learning of supervised segmentation and unsupervised masked context prediction for effectively learning the very limited labeled points and mass unlabeled points, respectively. Extensive experiments on the widely-tested ScanNet V2 and S3DIS benchmarks demonstrate the superiority of CPCM over the state-of-the-art.","url_abs":"https://arxiv.org/abs/2307.10316v1","url_pdf":"https://arxiv.org/pdf/2307.10316v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cpcm-contextual-point-cloud-modeling-for","repo_url":"https://github.com/lizhaoliu-Lec/CPCM","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"mae","method_name":"MAE"},{"method_slug":"fail","method_name":"fail"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.10316","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.10316"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/lizhaoliu-Lec/CPCM","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":10,"unverified":1},"by_repo_kind":{"official":{"samples":11,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"95b5d00548dba1c3","entry":"all_gather","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/distributed.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/distributed.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"95b5d00548dba1c3"}},{"code_sha256_prefix":"21a20dd6b4072587","entry":"all_gather_differentiable","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/distributed.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/distributed.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"21a20dd6b4072587"}},{"code_sha256_prefix":"e9cb06004b17fb2e","entry":"colorize_pointcloud","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/pc_utils.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/pc_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e9cb06004b17fb2e"}},{"code_sha256_prefix":"3e350d1ea4a3538d","entry":"fast_hist","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/utils.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e350d1ea4a3538d"}},{"code_sha256_prefix":"7b044f8063a9b668","entry":"is_master_proc","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/distributed.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/distributed.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7b044f8063a9b668"}},{"code_sha256_prefix":"04dfd706a56764cb","entry":"load_state_with_same_shape","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/utils.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"04dfd706a56764cb"}},{"code_sha256_prefix":"4f6287104e513039","entry":"precision_at_one","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/utils.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4f6287104e513039"}},{"code_sha256_prefix":"1d1392e58959df67","entry":"random_sampling","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/pc_utils.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/pc_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1d1392e58959df67"}},{"code_sha256_prefix":"2959b7c77776b51d","entry":"read_plyfile","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"lib/pc_utils.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/lib/pc_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2959b7c77776b51d"}},{"code_sha256_prefix":"09cb5ffa3484c7c1","entry":"torch_intersect","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"model/build.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/model/build.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09cb5ffa3484c7c1"}},{"code_sha256_prefix":"5436174f8c0e64e0","entry":"trunc_normal_","repo":"lizhaoliu-Lec/CPCM","repo_kind":"official","path":"model/res16unet.py","file_url":"https://github.com/lizhaoliu-Lec/CPCM/blob/HEAD/model/res16unet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5436174f8c0e64e0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}