{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/molecular-geometry-pretraining-with-se-3","title":"Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance Matching","arxiv_id":"2206.13602","date":"2022-06-27","proceeding":null,"authors":["Shengchao Liu","Hongyu Guo","Jian Tang"],"abstract":"Molecular representation pretraining is critical in various applications for drug and material discovery due to the limited number of labeled molecules, and most existing work focuses on pretraining on 2D molecular graphs. However, the power of pretraining on 3D geometric structures has been less explored. This is owing to the difficulty of finding a sufficient proxy task that can empower the pretraining to effectively extract essential features from the geometric structures. Motivated by the dynamic nature of 3D molecules, where the continuous motion of a molecule in the 3D Euclidean space forms a smooth potential energy surface, we propose GeoSSL, a 3D coordinate denoising pretraining framework to model such an energy landscape. Further by leveraging an SE(3)-invariant score matching method, we propose GeoSSL-DDM in which the coordinate denoising proxy task is effectively boiled down to denoising the pairwise atomic distances in a molecule. Our comprehensive experiments confirm the effectiveness and robustness of our proposed method.","url_abs":"https://arxiv.org/abs/2206.13602v2","url_pdf":"https://arxiv.org/pdf/2206.13602v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"molecular-geometry-pretraining-with-se-3","repo_url":"https://github.com/chao1224/geossl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"molecular-geometry-pretraining-with-se-3","repo_url":"https://github.com/chao1224/se3ddm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"molecular-representation","task_name":"molecular representation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2206.13602","atlas_url":"https://app.syntology.ai/?focus=2206.13602","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.13602"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chao1224/geossl","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chao1224/se3ddm","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"unverified":2},"by_repo_kind":{"official":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"65786b73b73d6341","entry":"build_mlp","repo":"chao1224/geossl","repo_kind":"official","path":"Geom3D/models/painn_utils.py","file_url":"https://github.com/chao1224/geossl/blob/HEAD/Geom3D/models/painn_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65786b73b73d6341"}},{"code_sha256_prefix":"3bc223bc2ae6e073","entry":"find_files","repo":"chao1224/geossl","repo_kind":"official","path":"Geom3D/datasets/PDBBind_utils.py","file_url":"https://github.com/chao1224/geossl/blob/HEAD/Geom3D/datasets/PDBBind_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3bc223bc2ae6e073"}},{"code_sha256_prefix":"0bc799607dfc2ea1","entry":"get_pdb_code","repo":"chao1224/geossl","repo_kind":"official","path":"Geom3D/datasets/PDBBind_utils.py","file_url":"https://github.com/chao1224/geossl/blob/HEAD/Geom3D/datasets/PDBBind_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0bc799607dfc2ea1"}},{"code_sha256_prefix":"15e04d34c7ff0fd5","entry":"replicate_module","repo":"chao1224/geossl","repo_kind":"official","path":"Geom3D/models/painn_utils.py","file_url":"https://github.com/chao1224/geossl/blob/HEAD/Geom3D/models/painn_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"15e04d34c7ff0fd5"}},{"code_sha256_prefix":"bc76859c3c792263","entry":"scatter_add","repo":"chao1224/geossl","repo_kind":"official","path":"Geom3D/models/painn_utils.py","file_url":"https://github.com/chao1224/geossl/blob/HEAD/Geom3D/models/painn_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc76859c3c792263"}},{"code_sha256_prefix":"28b2fbe38b9f2f65","entry":"get_basis","repo":"chao1224/geossl","repo_kind":"official","path":"Geom3D/models/utils.py","file_url":"https://github.com/chao1224/geossl/blob/HEAD/Geom3D/models/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"28b2fbe38b9f2f65"}},{"code_sha256_prefix":"60a5d7a113ab81a9","entry":"get_pocket_res","repo":"chao1224/geossl","repo_kind":"official","path":"Geom3D/datasets/PDBBind_utils.py","file_url":"https://github.com/chao1224/geossl/blob/HEAD/Geom3D/datasets/PDBBind_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"60a5d7a113ab81a9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}