{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/transfer-learning-on-large-datasets-for-the","title":"Transfer learning on large datasets for the accurate prediction of material properties","arxiv_id":"2303.03000","date":"2023-03-06","proceeding":null,"authors":["Noah Hoffmann","Jonathan Schmidt","Silvana Botti","Miguel A. L. Marques"],"abstract":"Graph neural networks trained on large crystal structure databases are extremely effective in replacing ab initio calculations in the discovery and characterization of materials. However, crystal structure datasets comprising millions of materials exist only for the Perdew-Burke-Ernzerhof (PBE) functional. In this work, we investigate the effectiveness of transfer learning to extend these models to other density functionals. We show that pre-training significantly reduces the size of the dataset required to achieve chemical accuracy and beyond. We also analyze in detail the relationship between the transfer-learning performance and the size of the datasets used for the initial training of the model and transfer learning. We confirm a linear dependence of the error on the size of the datasets on a log-log scale, with a similar slope for both training and the pre-training datasets. This shows that further increasing the size of the pre-training dataset, i.e. performing additional calculations with a low-cost functional, is also effective, through transfer learning, in improving machine-learning predictions with the quality of a more accurate, and possibly computationally more involved functional. Lastly, we compare the efficacy of interproperty and intraproperty transfer learning.","url_abs":"https://arxiv.org/abs/2303.03000v1","url_pdf":"https://arxiv.org/pdf/2303.03000v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"transfer-learning-on-large-datasets-for-the","repo_url":"https://github.com/hyllios/cgat","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2303.03000","atlas_url":"https://app.syntology.ai/?focus=2303.03000","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.03000"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hyllios/cgat","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":8,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":11,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ed4c4fb6f0b92a4f","entry":"EmbeddingData","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/gaussian_process.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/gaussian_process.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ed4c4fb6f0b92a4f"}},{"code_sha256_prefix":"b0f69de75228afa8","entry":"RobustL1","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/utils.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b0f69de75228afa8"}},{"code_sha256_prefix":"246cbb4029d172f0","entry":"RobustL2","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/utils.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"246cbb4029d172f0"}},{"code_sha256_prefix":"204d873b8398e305","entry":"collate_batch","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/prepare_data.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/prepare_data.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"204d873b8398e305"}},{"code_sha256_prefix":"46632866f370425f","entry":"collate_batch2","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/prepare_data.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/prepare_data.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"46632866f370425f"}},{"code_sha256_prefix":"89e043c8a52cac6a","entry":"collate_fn","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/lightning_module.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/lightning_module.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"89e043c8a52cac6a"}},{"code_sha256_prefix":"efeccd6b04404ad9","entry":"cyclical_lr","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/utils.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"efeccd6b04404ad9"}},{"code_sha256_prefix":"c9619b9e20a7fef4","entry":"lamb_kernel","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/lambs.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/lambs.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c9619b9e20a7fef4"}},{"code_sha256_prefix":"61098cd5c9624563","entry":"partialclass","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/Hypernetworksmp.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/Hypernetworksmp.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"61098cd5c9624563"}},{"code_sha256_prefix":"34348fa866d9d6bc","entry":"build_dataset_prepare","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/prepare_data.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/prepare_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"34348fa866d9d6bc"}},{"code_sha256_prefix":"edbe36714aa4acc4","entry":"collate_batch","repo":"hyllios/cgat","repo_kind":"official","path":"CGAT/roost_message.py","file_url":"https://github.com/hyllios/cgat/blob/HEAD/CGAT/roost_message.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"edbe36714aa4acc4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}