{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/improving-molecular-properties-prediction","title":"Improving Molecular Properties Prediction Through Latent Space Fusion","arxiv_id":"2310.13802","date":"2023-10-20","proceeding":null,"authors":["Eduardo Soares","Akihiro Kishimoto","Emilio Vital Brazil","Seiji Takeda","Hiroshi Kajino","Renato Cerqueira"],"abstract":"Pre-trained Language Models have emerged as promising tools for predicting molecular properties, yet their development is in its early stages, necessitating further research to enhance their efficacy and address challenges such as generalization and sample efficiency. In this paper, we present a multi-view approach that combines latent spaces derived from state-of-the-art chemical models. Our approach relies on two pivotal elements: the embeddings derived from MHG-GNN, which represent molecular structures as graphs, and MoLFormer embeddings rooted in chemical language. The attention mechanism of MoLFormer is able to identify relations between two atoms even when their distance is far apart, while the GNN of MHG-GNN can more precisely capture relations among multiple atoms closely located. In this work, we demonstrate the superior performance of our proposed multi-view approach compared to existing state-of-the-art methods, including MoLFormer-XL, which was trained on 1.1 billion molecules, particularly in intricate tasks such as predicting clinical trial drug toxicity and inhibiting HIV replication. We assessed our approach using six benchmark datasets from MoleculeNet, where it outperformed competitors in five of them. Our study highlights the potential of latent space fusion and feature integration for advancing molecular property prediction. In this work, we use small versions of MHG-GNN and MoLFormer, which opens up an opportunity for further improvement when our approach uses a larger-scale dataset.","url_abs":"https://arxiv.org/abs/2310.13802v1","url_pdf":"https://arxiv.org/pdf/2310.13802v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"improving-molecular-properties-prediction","repo_url":"https://github.com/ibm/molformer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"molecular-property-prediction","task_name":"Molecular Property Prediction"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"property-prediction","task_name":"Property Prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.13802","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.13802"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/IBM/molformer","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ibm/molformer","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_honours":1,"ran":3,"unverified":2},"by_repo_kind":{"official":{"samples":6,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"586e66fcc2f1243d","entry":"RMSELoss","repo":"IBM/molformer","repo_kind":"official","path":"finetune/finetune_pubchem_light.py","file_url":"https://github.com/IBM/molformer/blob/HEAD/finetune/finetune_pubchem_light.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"586e66fcc2f1243d"}},{"code_sha256_prefix":"80d40f9800211e41","entry":"apply_rotary_pos_emb","repo":"IBM/molformer","repo_kind":"official","path":"finetune/rotate_attention/rotary.py","file_url":"https://github.com/IBM/molformer/blob/HEAD/finetune/rotate_attention/rotary.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"80d40f9800211e41"}},{"code_sha256_prefix":"a82c749dc3fda0e4","entry":"get_all_proteins","repo":"IBM/molformer","repo_kind":"official","path":"finetune/utils.py","file_url":"https://github.com/IBM/molformer/blob/HEAD/finetune/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a82c749dc3fda0e4"}},{"code_sha256_prefix":"66af878036f6eae3","entry":"transform_single_embedding_to_multiple","repo":"IBM/molformer","repo_kind":"official","path":"finetune/utils.py","file_url":"https://github.com/IBM/molformer/blob/HEAD/finetune/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"66af878036f6eae3"}},{"code_sha256_prefix":"1d370a2640ad13f9","entry":"get_parser","repo":"IBM/molformer","repo_kind":"official","path":"finetune/args.py","file_url":"https://github.com/IBM/molformer/blob/HEAD/finetune/args.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1d370a2640ad13f9"}},{"code_sha256_prefix":"766ad0e51b7a8f09","entry":"rotate_half","repo":"IBM/molformer","repo_kind":"official","path":"finetune/rotate_attention/rotary.py","file_url":"https://github.com/IBM/molformer/blob/HEAD/finetune/rotate_attention/rotary.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"766ad0e51b7a8f09"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}