{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/self-supervised-learning-for-multimodal-non","title":"Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matching","arxiv_id":"2303.10971","date":"2023-03-20","proceeding":"CVPR 2023 1","authors":["Dongliang Cao","Florian Bernard"],"abstract":"The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser scanners), meshes encode rich and expressive topological information, but their creation typically requires some form of (often manual) curation. In turn, methods that purely rely on point clouds are unable to meet the matching quality of mesh-based methods that utilise the additional topological structure. In this work we close this gap by introducing a self-supervised multimodal learning strategy that combines mesh-based functional map regularisation with a contrastive loss that couples mesh and point cloud data. Our shape matching approach allows to obtain intramodal correspondences for triangle meshes, complete point clouds, and partially observed point clouds, as well as correspondences across these data modalities. We demonstrate that our method achieves state-of-the-art results on several challenging benchmark datasets even in comparison to recent supervised methods, and that our method reaches previously unseen cross-dataset generalisation ability.","url_abs":"https://arxiv.org/abs/2303.10971v1","url_pdf":"https://arxiv.org/pdf/2303.10971v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"self-supervised-learning-for-multimodal-non","repo_url":"https://github.com/dongliangcao/Self-Supervised-Multimodal-Shape-Matching","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2303.10971","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.10971"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dongliangcao/Self-Supervised-Multimodal-Shape-Matching","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"ran":1,"unverified":1},"by_repo_kind":{"official":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"aee5b68c94193ed9","entry":"get_mask","repo":"dongliangcao/Self-Supervised-Multimodal-Shape-Matching","repo_kind":"official","path":"networks/fmap_network.py","file_url":"https://github.com/dongliangcao/Self-Supervised-Multimodal-Shape-Matching/blob/HEAD/networks/fmap_network.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aee5b68c94193ed9"}},{"code_sha256_prefix":"cd569444547de84f","entry":"get_position_from_periods","repo":"dongliangcao/Self-Supervised-Multimodal-Shape-Matching","repo_kind":"official","path":"models/lr_scheduler.py","file_url":"https://github.com/dongliangcao/Self-Supervised-Multimodal-Shape-Matching/blob/HEAD/models/lr_scheduler.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cd569444547de84f"}},{"code_sha256_prefix":"11a11c8c50868aa7","entry":"sort_list","repo":"dongliangcao/Self-Supervised-Multimodal-Shape-Matching","repo_kind":"official","path":"datasets/shape_dataset.py","file_url":"https://github.com/dongliangcao/Self-Supervised-Multimodal-Shape-Matching/blob/HEAD/datasets/shape_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"11a11c8c50868aa7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}