{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-12364","title":"Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions","arxiv_id":"2604.12364","date":"2026-04-14","proceeding":null,"authors":["Gregor Krzmanc","Vinicius Mikuni","Benjamin Nachman","Callum Wilkinson"],"abstract":"Future AI-based studies in particle physics will likely start from a foundation model to accelerate training and enhance sensitivity. As a step toward a general-purpose foundation model for particle physics, we investigate whether the OmniLearned and ParticleViT foundation models pretrained on diverse high-$Q^2$ simulated and real $pp$ and $ep$ collisions retain useful knowledge to a few-GeV fixed-target neutrino experiment. We process MINERvA neutrino--nucleus scattering events and evaluate pretrained models on two types of tasks: regression of available energy and binary classification of charged-current pion final states ($\\mathrm{CC1π^{\\pm}}$, $\\mathrm{CCNπ^{\\pm}}$, and $\\mathrm{CC1π^{0}}$). Pretrained OmniLearned and ParticleViT models outperform similarly sized models trained from scratch at the same compute budget, with the largest gains for OmniLearned on regression and for ParticleViT on classification. When the same transformer architecture is instead initialized from unrelated text pretraining (BERT), this advantage appears only marginally for classification in terms of compute efficiency and not in any way for regression. These results suggest that particle-level foundation models acquire inductive biases that generalize across large differences in energy scale, detector technology, and underlying physics processes, pointing toward detector-agnostic inference in particle physics.","url_abs":"https://arxiv.org/abs/2604.12364","url_pdf":"https://arxiv.org/pdf/2604.12364","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2604.12364","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.12364"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/gregorkrz/minerva-ml","reach":null}],"summary":{"unverified":13},"by_repo_kind":{"found_in_text":{"samples":13,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":13,"samples":[{"code_sha256_prefix":"e13063e95d827286","entry":"collate_point_cloud","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/dataloader.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e13063e95d827286"}},{"code_sha256_prefix":"86a0b2999faa8f4a","entry":"collate_tabular_cond","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/dataloader.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"86a0b2999faa8f4a"}},{"code_sha256_prefix":"f41abcd992895d14","entry":"event_display","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/event_displays.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/event_displays.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f41abcd992895d14"}},{"code_sha256_prefix":"531059fe785ab772","entry":"get_Pi_labels_v2_from_baseline","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/baseline_labels.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/baseline_labels.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"531059fe785ab772"}},{"code_sha256_prefix":"b97318cc94d269c7","entry":"get_photons","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/preprocessing.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/preprocessing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"b97318cc94d269c7"}},{"code_sha256_prefix":"ccaea061b1475ef0","entry":"light_cache_model_keys","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/eval/_cache_additive.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/eval/_cache_additive.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"ccaea061b1475ef0"}},{"code_sha256_prefix":"f49e5b0d40401aa1","entry":"load_baseline_pi_labels_v2","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/baseline_labels.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/baseline_labels.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f49e5b0d40401aa1"}},{"code_sha256_prefix":"e97dd2db2c32f660","entry":"load_kinematic_values","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/binned_loss_weights.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/binned_loss_weights.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e97dd2db2c32f660"}},{"code_sha256_prefix":"a52eb2bb4012ab0d","entry":"load_metrics_cache","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/eval/_classification_metrics_cache.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/eval/_classification_metrics_cache.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a52eb2bb4012ab0d"}},{"code_sha256_prefix":"8f045049b8f2366e","entry":"metrics_cache_model_keys","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/eval/_cache_additive.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/eval/_cache_additive.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"8f045049b8f2366e"}},{"code_sha256_prefix":"c316d0a425c7727c","entry":"parse_event_types","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/dataset/dataloader.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/dataset/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c316d0a425c7727c"}},{"code_sha256_prefix":"7dbe17aefb0fce8d","entry":"per_bin_total_and_signal","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/eval/_classification_light.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/eval/_classification_light.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"7dbe17aefb0fce8d"}},{"code_sha256_prefix":"3046f98fdd8f087e","entry":"resolve_models_to_add","repo":"gregorkrz/minerva-ml","repo_kind":"found_in_text","path":"src/eval/_cache_additive.py","file_url":"https://github.com/gregorkrz/minerva-ml/blob/HEAD/src/eval/_cache_additive.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"3046f98fdd8f087e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}