{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2608-18982","title":"Monroe: A Molecular Foundation Model for In-Context Probabilistic Inference","arxiv_id":"2608.18982","date":"2026-08-19","proceeding":null,"authors":["Blazej Banaszewski","Andrew W. Fitzgibbon"],"abstract":"Bioassay activity prediction is often data-limited because drug-discovery datasets rely on time-consuming and expensive wet-lab experiments for data generation and evaluation. This challenge has inspired recent research into molecular foundation models (MFMs), which aim to encode general-purpose chemical knowledge into molecular representations that generalize well in data-constrained scenarios. This paper presents Monroe, a new MFM with several innovations over the existing state of the art: increased scale allowing pre-training on over 81 million molecules from the PM6 quantum chemistry dataset; improved graph representation of stereochemistry; improved training losses including conformer denoising and embedding decorrelation; improved multi-task learning; and the use of a prior-data-fitted model (TabPFN) for downstream in-context prediction. Our evaluations use a principled pairwise comparison framework that measures statistically significant performance differences. Across established Polaris benchmarks, Monroe matches or exceeds existing MFMs, while on activity cliff benchmarks, designed to assess utility for molecular discovery, it achieves significant improvements over prior methods. Finally, ablation and transfer experiments show that PFN-based downstream predictors also substantially improve two leading existing models, MiniMol and CheMeleon, yielding new state-of-the-art variants we call MiniMol_PFN and CheMeleon_PFN, suggesting that our downstream adaptation strategy generalizes beyond Monroe. Source code is at github.com/blazejba/monroe.","url_abs":"https://arxiv.org/abs/2608.18982","url_pdf":"https://arxiv.org/pdf/2608.18982","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2608.18982"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/blazejba/monroe","reach":null}],"summary":{"ran":8,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":9,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"5b6975b6b6b3b071","entry":"build_dataset_heads","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/model/heads.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/model/heads.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5b6975b6b6b3b071"}},{"code_sha256_prefix":"584fb941774c80b1","entry":"count_parameters","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/utils.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"584fb941774c80b1"}},{"code_sha256_prefix":"96e3b86b749f8844","entry":"dict_to_namespace","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/config.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"96e3b86b749f8844"}},{"code_sha256_prefix":"c338b309c53d50dc","entry":"encode_code","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/model/featurizer.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/model/featurizer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c338b309c53d50dc"}},{"code_sha256_prefix":"ecf6bb5764215221","entry":"is_flat","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/run_inference.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/run_inference.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ecf6bb5764215221"}},{"code_sha256_prefix":"06dd13a19745696b","entry":"off_diag_cov_loss","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/train/loss.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/train/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06dd13a19745696b"}},{"code_sha256_prefix":"eef57ea43171033d","entry":"str2bool","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/utils.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eef57ea43171033d"}},{"code_sha256_prefix":"13bbeae9ca468095","entry":"to_dict","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/config.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"13bbeae9ca468095"}},{"code_sha256_prefix":"b5d78e8e5f5150f2","entry":"load_training_ckpt","repo":"blazejba/monroe","repo_kind":"found_in_text","path":"monroe/model/ckpt.py","file_url":"https://github.com/blazejba/monroe/blob/HEAD/monroe/model/ckpt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b5d78e8e5f5150f2"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":1,"rejected_by_independent_check":0,"refused_by_a_rule":1,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}