{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/multi-body-se-3-equivariance-for-unsupervised","title":"Multi-body SE(3) Equivariance for Unsupervised Rigid Segmentation and Motion Estimation","arxiv_id":"2306.05584","date":"2023-06-08","proceeding":"NeurIPS 2023 11","authors":["Jia-Xing Zhong","Ta-Ying Cheng","Yuhang He","Kai Lu","Kaichen Zhou","Andrew Markham","Niki Trigoni"],"abstract":"A truly generalizable approach to rigid segmentation and motion estimation is fundamental to 3D understanding of articulated objects and moving scenes. In view of the closely intertwined relationship between segmentation and motion estimates, we present an SE(3) equivariant architecture and a training strategy to tackle this task in an unsupervised manner. Our architecture is composed of two interconnected, lightweight heads. These heads predict segmentation masks using point-level invariant features and estimate motion from SE(3) equivariant features, all without the need for category information. Our training strategy is unified and can be implemented online, which jointly optimizes the predicted segmentation and motion by leveraging the interrelationships among scene flow, segmentation mask, and rigid transformations. We conduct experiments on four datasets to demonstrate the superiority of our method. The results show that our method excels in both model performance and computational efficiency, with only 0.25M parameters and 0.92G FLOPs. To the best of our knowledge, this is the first work designed for category-agnostic part-level SE(3) equivariance in dynamic point clouds.","url_abs":"https://arxiv.org/abs/2306.05584v2","url_pdf":"https://arxiv.org/pdf/2306.05584v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"multi-body-se-3-equivariance-for-unsupervised","repo_url":"https://github.com/jx-zhong-for-academic-purpose/Multibody_SE3","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"computational-efficiency","task_name":"Computational Efficiency"},{"task_slug":"motion-estimation","task_name":"Motion Estimation"},{"task_slug":"segmentation","task_name":"Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2306.05584","atlas_url":"https://app.syntology.ai/?focus=2306.05584","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.05584"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/jx-zhong-for-academicpurpose/Multibody_SE3","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jx-zhong-for-academic-purpose/Multibody_SE3","reach":null}],"summary":{"ran":2,"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"dae09fdf19f20c9d","entry":"PointnetSO3PointwiseConv","repo":"jx-zhong-for-academic-purpose/Multibody_SE3","repo_kind":"official","path":"EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","file_url":"https://github.com/jx-zhong-for-academic-purpose/Multibody_SE3/blob/HEAD/EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"dae09fdf19f20c9d"}},{"code_sha256_prefix":"be56d57d80493bcb","entry":"PointwiseRelSO3OutBlockR","repo":"jx-zhong-for-academic-purpose/Multibody_SE3","repo_kind":"official","path":"EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","file_url":"https://github.com/jx-zhong-for-academic-purpose/Multibody_SE3/blob/HEAD/EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"be56d57d80493bcb"}},{"code_sha256_prefix":"85ef5c568bd067f2","entry":"InvSO3ConvModel","repo":"jx-zhong-for-academic-purpose/Multibody_SE3","repo_kind":"official","path":"EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","file_url":"https://github.com/jx-zhong-for-academic-purpose/Multibody_SE3/blob/HEAD/EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"85ef5c568bd067f2"}},{"code_sha256_prefix":"4c8376ccba7fc54f","entry":"SphericalPointCloud","repo":"jx-zhong-for-academic-purpose/Multibody_SE3","repo_kind":"official","path":"EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","file_url":"https://github.com/jx-zhong-for-academic-purpose/Multibody_SE3/blob/HEAD/EPN_PointCloud/SPConvNets/models/eq_2head_so3net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4c8376ccba7fc54f"}},{"code_sha256_prefix":"accfe94474ce33c2","entry":"bn_curve","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"accfe94474ce33c2"}},{"code_sha256_prefix":"fd2cd55cd5c23e2d","entry":"lr_curve","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"fd2cd55cd5c23e2d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}