{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/all-points-matter-entropy-regularized-1","title":"All Points Matter: Entropy-Regularized Distribution Alignment for Weakly-supervised 3D Segmentation","arxiv_id":"2305.15832","date":"2023-05-25","proceeding":"NeurIPS 2023 11","authors":["Liyao Tang","Zhe Chen","Shanshan Zhao","Chaoyue Wang","DaCheng Tao"],"abstract":"Pseudo-labels are widely employed in weakly supervised 3D segmentation tasks where only sparse ground-truth labels are available for learning. Existing methods often rely on empirical label selection strategies, such as confidence thresholding, to generate beneficial pseudo-labels for model training. This approach may, however, hinder the comprehensive exploitation of unlabeled data points. We hypothesize that this selective usage arises from the noise in pseudo-labels generated on unlabeled data. The noise in pseudo-labels may result in significant discrepancies between pseudo-labels and model predictions, thus confusing and affecting the model training greatly. To address this issue, we propose a novel learning strategy to regularize the generated pseudo-labels and effectively narrow the gaps between pseudo-labels and model predictions. More specifically, our method introduces an Entropy Regularization loss and a Distribution Alignment loss for weakly supervised learning in 3D segmentation tasks, resulting in an ERDA learning strategy. Interestingly, by using KL distance to formulate the distribution alignment loss, it reduces to a deceptively simple cross-entropy-based loss which optimizes both the pseudo-label generation network and the 3D segmentation network simultaneously. Despite the simplicity, our method promisingly improves the performance. We validate the effectiveness through extensive experiments on various baselines and large-scale datasets. Results show that ERDA effectively enables the effective usage of all unlabeled data points for learning and achieves state-of-the-art performance under different settings. Remarkably, our method can outperform fully-supervised baselines using only 1% of true annotations. Code and model will be made publicly available at https://github.com/LiyaoTang/ERDA.","url_abs":"https://arxiv.org/abs/2305.15832v2","url_pdf":"https://arxiv.org/pdf/2305.15832v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"all-points-matter-entropy-regularized-1","repo_url":"https://github.com/LiyaoTang/ERDA","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[{"task_slug":"all","task_name":"All"},{"task_slug":"pseudo-label","task_name":"Pseudo Label"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"weakly-supervised-learning","task_name":"Weakly-supervised Learning"}],"methods":[{"method_slug":"entropy-regularization","method_name":"Entropy Regularization"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2305.15832","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.15832"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/LiyaoTang/ERDA","reach":null}],"summary":{"ran":7,"ran_violates":1,"ran_draft_wrong":6,"ran_fixture":1,"ran_honours":1,"unverified":17},"by_repo_kind":{"official":{"samples":33,"ran":16,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"65566e34fbee2d02","entry":"apply_reduction","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65566e34fbee2d02"}},{"code_sha256_prefix":"585514b22f60ec47","entry":"check_mask","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"585514b22f60ec47"}},{"code_sha256_prefix":"66f4ca8e47d66009","entry":"dropout","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"66f4ca8e47d66009"}},{"code_sha256_prefix":"9166f0042b70f6a0","entry":"fetch_supports_stage","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9166f0042b70f6a0"}},{"code_sha256_prefix":"6f022cb10fccee9d","entry":"get_activation","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6f022cb10fccee9d"}},{"code_sha256_prefix":"36d027452f58eb43","entry":"get_class_weight","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"36d027452f58eb43"}},{"code_sha256_prefix":"11f40ad83f37e95f","entry":"get_ftype","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"11f40ad83f37e95f"}},{"code_sha256_prefix":"b9980bfcdc9fa508","entry":"get_initializer","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b9980bfcdc9fa508"}},{"code_sha256_prefix":"6eb3a7a026e881ba","entry":"get_kwargs","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6eb3a7a026e881ba"}},{"code_sha256_prefix":"a36a27d7a5eeaf3e","entry":"get_kwargs_mlp","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a36a27d7a5eeaf3e"}},{"code_sha256_prefix":"65a09d51e78e2ff8","entry":"get_type","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65a09d51e78e2ff8"}},{"code_sha256_prefix":"72be9593f760bb29","entry":"masked_softmax","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"72be9593f760bb29"}},{"code_sha256_prefix":"0822e0ff9c4729a5","entry":"tf_cond","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0822e0ff9c4729a5"}},{"code_sha256_prefix":"862351355d71ffc6","entry":"tf_gather","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"862351355d71ffc6"}},{"code_sha256_prefix":"7153a8b6464f04ea","entry":"tf_scope","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7153a8b6464f04ea"}},{"code_sha256_prefix":"532f90a2c87f9f32","entry":"to_valid_stage","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"532f90a2c87f9f32"}},{"code_sha256_prefix":"ce6452caa8be618b","entry":"_variable_on_cpu","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce6452caa8be618b"}},{"code_sha256_prefix":"d98ee661d06ca55e","entry":"_variable_with_weight_decay","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d98ee661d06ca55e"}},{"code_sha256_prefix":"0c8f88cadeb2d45f","entry":"batch_norm","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c8f88cadeb2d45f"}},{"code_sha256_prefix":"34736bc6edd358fa","entry":"calc_dist","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"34736bc6edd358fa"}},{"code_sha256_prefix":"87082c78c01cdcc8","entry":"calc_loss","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87082c78c01cdcc8"}},{"code_sha256_prefix":"2b0265835b2b9e32","entry":"cls_contrast_head","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b0265835b2b9e32"}},{"code_sha256_prefix":"2101a28ba054c714","entry":"conv1d_1x1","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2101a28ba054c714"}},{"code_sha256_prefix":"6a695291eaa9bee6","entry":"dense_layer","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6a695291eaa9bee6"}},{"code_sha256_prefix":"a3a2fe6e67287299","entry":"get_sample_idx","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a3a2fe6e67287299"}},{"code_sha256_prefix":"77f37437581eb0b7","entry":"get_scene_label","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"77f37437581eb0b7"}},{"code_sha256_prefix":"747ee8f1f284c303","entry":"mlp_head","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"747ee8f1f284c303"}},{"code_sha256_prefix":"95ee8413bb72a5d2","entry":"mlps","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"95ee8413bb72a5d2"}},{"code_sha256_prefix":"b5717e76cb07f225","entry":"mlps_by_ops","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b5717e76cb07f225"}},{"code_sha256_prefix":"114618f6f9dc6b02","entry":"normalize","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"114618f6f9dc6b02"}},{"code_sha256_prefix":"c1132af83963c82c","entry":"parse_stage","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1132af83963c82c"}},{"code_sha256_prefix":"b62f118649752c42","entry":"pseudo_head","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b62f118649752c42"}},{"code_sha256_prefix":"5271d891a74ff73e","entry":"tf_get_variable","repo":"LiyaoTang/ERDA","repo_kind":"official","path":"models/head.py","file_url":"https://github.com/LiyaoTang/ERDA/blob/HEAD/models/head.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5271d891a74ff73e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}