{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-08988","title":"Benchmarking Compositional Generalisation for Machine Learning Interatomic Potentials","arxiv_id":"2605.08988","date":"2026-05-09","proceeding":null,"authors":["Amir Masoud Nourollah","Irtaza Khalid","Stefano Leoni","Steven Schockaert"],"abstract":"Machine Learning Interatomic Potentials play a fundamental role in computational chemistry and materials science, enabling applications from molecular dynamics simulations to drug design and materials discovery. While recent approaches can estimate inter-atomic forces with high precision, it remains unclear to what extent they can generalise to previously unseen molecules. Do they learn the compositional structure of chemistry, capturing how molecular fragments and their combinations determine properties, or do they primarily learn to interpolate patterns that are specific to the training examples? To address this question, we propose a benchmark consisting of four tasks that require some form of compositional generalisation. In each task, models are tested on molecules that were unseen during training, but the training data is chosen such that generalisation to the test examples should be feasible for models that learn the underlying physical principles. Our empirical analysis shows that the considered tasks are highly challenging for state-of-the-art models, with errors on out-of-distribution examples often an order of magnitude higher than on in-distribution examples, even when using foundation models that have been pre-trained on millions of molecules.","url_abs":"https://arxiv.org/abs/2605.08988","url_pdf":"https://arxiv.org/pdf/2605.08988","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.08988"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Nourollah/GMD-26","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Nourollah/GOAL","reach":null}],"summary":{"ran":3,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":6,"ran":3,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"1e9c1139b6d62d37","entry":"fluent","repo":"Nourollah/GMD-26","repo_kind":"found_in_text","path":"src/gmd_26/core/base.py","file_url":"https://github.com/Nourollah/GMD-26/blob/HEAD/src/gmd_26/core/base.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e9c1139b6d62d37"}},{"code_sha256_prefix":"531ffa3bd17e7ed0","entry":"register_calculator","repo":"Nourollah/GMD-26","repo_kind":"found_in_text","path":"src/gmd_26/core/md_factory.py","file_url":"https://github.com/Nourollah/GMD-26/blob/HEAD/src/gmd_26/core/md_factory.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"531ffa3bd17e7ed0"}},{"code_sha256_prefix":"a774b629984f62f6","entry":"requires_calculator","repo":"Nourollah/GMD-26","repo_kind":"found_in_text","path":"src/gmd_26/core/base.py","file_url":"https://github.com/Nourollah/GMD-26/blob/HEAD/src/gmd_26/core/base.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a774b629984f62f6"}},{"code_sha256_prefix":"e95c1a14af825673","entry":"generate_3d_coordinates_from_smiles","repo":"Nourollah/GOAL","repo_kind":"found_in_text","path":"src/goal/md/core/molecule_tools.py","file_url":"https://github.com/Nourollah/GOAL/blob/HEAD/src/goal/md/core/molecule_tools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e95c1a14af825673"}},{"code_sha256_prefix":"d9a5af5a8c918234","entry":"get_model_cutoff","repo":"Nourollah/GOAL","repo_kind":"found_in_text","path":"src/goal/md/adapters/model_loader.py","file_url":"https://github.com/Nourollah/GOAL/blob/HEAD/src/goal/md/adapters/model_loader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d9a5af5a8c918234"}},{"code_sha256_prefix":"30772667ba14c8ac","entry":"requires_molecule","repo":"Nourollah/GMD-26","repo_kind":"found_in_text","path":"src/gmd_26/core/base.py","file_url":"https://github.com/Nourollah/GMD-26/blob/HEAD/src/gmd_26/core/base.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"30772667ba14c8ac"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}