{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/automated-3d-pre-training-for-molecular","title":"Automated 3D Pre-Training for Molecular Property Prediction","arxiv_id":"2306.07812","date":"2023-06-13","proceeding":null,"authors":["Xu Wang","Huan Zhao","WeiWei Tu","Quanming Yao"],"abstract":"Molecular property prediction is an important problem in drug discovery and materials science. As geometric structures have been demonstrated necessary for molecular property prediction, 3D information has been combined with various graph learning methods to boost prediction performance. However, obtaining the geometric structure of molecules is not feasible in many real-world applications due to the high computational cost. In this work, we propose a novel 3D pre-training framework (dubbed 3D PGT), which pre-trains a model on 3D molecular graphs, and then fine-tunes it on molecular graphs without 3D structures. Based on fact that bond length, bond angle, and dihedral angle are three basic geometric descriptors corresponding to a complete molecular 3D conformer, we first develop a multi-task generative pre-train framework based on these three attributes. Next, to automatically fuse these three generative tasks, we design a surrogate metric using the \\textit{total energy} to search for weight distribution of the three pretext task since total energy corresponding to the quality of 3D conformer.Extensive experiments on 2D molecular graphs are conducted to demonstrate the accuracy, efficiency and generalization ability of the proposed 3D PGT compared to various pre-training baselines.","url_abs":"https://arxiv.org/abs/2306.07812v2","url_pdf":"https://arxiv.org/pdf/2306.07812v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"automated-3d-pre-training-for-molecular","repo_url":"https://github.com/lars-research/3d-pgt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"drug-discovery","task_name":"Drug Discovery"},{"task_slug":"graph-learning","task_name":"Graph Learning"},{"task_slug":"molecular-property-prediction","task_name":"Molecular Property Prediction"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"property-prediction","task_name":"Property Prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2306.07812","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.07812"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lars-research/3d-pgt","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"unverified":9},"by_repo_kind":{"official":{"samples":13,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1bb331bf70a78136","entry":"get_final_pretrained_ckpt","repo":"lars-research/3d-pgt","repo_kind":"official","path":"graphgps/finetuning.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/graphgps/finetuning.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1bb331bf70a78136"}},{"code_sha256_prefix":"9e4db46ba20af98e","entry":"init_model_from_pretrained","repo":"lars-research/3d-pgt","repo_kind":"official","path":"graphgps/finetuning.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/graphgps/finetuning.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e4db46ba20af98e"}},{"code_sha256_prefix":"e5d413a517864727","entry":"load_SMILES_list","repo":"lars-research/3d-pgt","repo_kind":"official","path":"GEOM_dataset_preparation.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/GEOM_dataset_preparation.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e5d413a517864727"}},{"code_sha256_prefix":"556ccfd77bd3c202","entry":"safe_index","repo":"lars-research/3d-pgt","repo_kind":"official","path":"local_feature.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/local_feature.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"556ccfd77bd3c202"}},{"code_sha256_prefix":"05c29fe3afb7b453","entry":"atom_to_feature_vector","repo":"lars-research/3d-pgt","repo_kind":"official","path":"local_feature.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/local_feature.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05c29fe3afb7b453"}},{"code_sha256_prefix":"3458fb8ee185727f","entry":"atom_to_vocab","repo":"lars-research/3d-pgt","repo_kind":"official","path":"datasets/molecule_contextual_datasets_utils.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/datasets/molecule_contextual_datasets_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3458fb8ee185727f"}},{"code_sha256_prefix":"d043f3bfddd0d5a1","entry":"bond_to_feature_vector","repo":"lars-research/3d-pgt","repo_kind":"official","path":"local_feature.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/local_feature.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d043f3bfddd0d5a1"}},{"code_sha256_prefix":"d574e555f2c73b1e","entry":"bond_to_vocab","repo":"lars-research/3d-pgt","repo_kind":"official","path":"datasets/molecule_contextual_datasets_utils.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/datasets/molecule_contextual_datasets_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d574e555f2c73b1e"}},{"code_sha256_prefix":"8b1c21372e10eb03","entry":"get_bond_feature_name","repo":"lars-research/3d-pgt","repo_kind":"official","path":"datasets/molecule_contextual_datasets_utils.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/datasets/molecule_contextual_datasets_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8b1c21372e10eb03"}},{"code_sha256_prefix":"4a563e1e2a6aa4b8","entry":"graph_data_obj_to_nx_simple","repo":"lars-research/3d-pgt","repo_kind":"official","path":"datasets/molecule_datasets.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/datasets/molecule_datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4a563e1e2a6aa4b8"}},{"code_sha256_prefix":"5f0dec6cfde34db0","entry":"load_molecule","repo":"lars-research/3d-pgt","repo_kind":"official","path":"datasets/molecule_contextual_datasets.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/datasets/molecule_contextual_datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f0dec6cfde34db0"}},{"code_sha256_prefix":"91c1f5bb90bbe0f3","entry":"load_pretrained_model_cfg","repo":"lars-research/3d-pgt","repo_kind":"official","path":"graphgps/finetuning.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/graphgps/finetuning.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"91c1f5bb90bbe0f3"}},{"code_sha256_prefix":"5a8726c5cdc38dd2","entry":"search_graph","repo":"lars-research/3d-pgt","repo_kind":"official","path":"datasets/datasets_GPT.py","file_url":"https://github.com/lars-research/3d-pgt/blob/HEAD/datasets/datasets_GPT.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5a8726c5cdc38dd2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}