{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-24995","title":"Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?","arxiv_id":"2606.24995","date":"2026-06-23","proceeding":null,"authors":["Giulia Perciballi","Ahmad Fall","Federica Granese","Edi Prifti","Jean-Daniel Zucker"],"abstract":"Tabular foundation models (TFMs) achieve strong performance on microbiome abundance data, yet their robustness under realistic distribution shift remains poorly characterized. We introduce a benchmark that evaluates the robustness of TFMs to biologically inspired perturbations across six gut microbiome datasets spanning four disease contexts. In this in-context learning setting, models receive unperturbed support sets as context and are evaluated on perturbed query samples. To isolate robustness beyond \"shortcut\" features, we preserve the most discriminative taxa and apply three controlled perturbation strategies: (i) removal of high-abundance (uninformative) taxa, (ii) sparsification via increased zero-inflation, and (iii) zero-imputation via spurious non-zero injections. Our results show that protecting discriminative features is insufficient to guarantee stability under support-query shift: across datasets, all perturbations degrade model performance, with zero-imputation consistently the most harmful, indicating that corrupting global feature structure can break generalization even when key taxa are retained. Sparsification disproportionately affects TFMs relative to a classical random forest baseline, suggesting greater sensitivity to zero-inflation-type shifts. The code is publicly available at: https://github.com/UMMISCO/metagenomics-fm/.","url_abs":"https://arxiv.org/abs/2606.24995","url_pdf":"https://arxiv.org/pdf/2606.24995","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.24995","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.24995"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/UMMISCO/metagenomics-fm","reach":null}],"summary":{"ran":5,"ran_draft_wrong":5,"ran_fixture":5,"ran_honours":1,"unverified":6},"by_repo_kind":{"found_in_text":{"samples":22,"ran":16,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"63eade775fbf2a51","entry":"DensificationPerturbation","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"63eade775fbf2a51"}},{"code_sha256_prefix":"6036b20bbf4528af","entry":"FeatureSelector","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6036b20bbf4528af"}},{"code_sha256_prefix":"a84e50ff24941d7b","entry":"Perturbation","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a84e50ff24941d7b"}},{"code_sha256_prefix":"ef93195611f2fa55","entry":"PerturbationStats","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef93195611f2fa55"}},{"code_sha256_prefix":"420a1cef63da4850","entry":"RemoveFeaturesPerturbation","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"420a1cef63da4850"}},{"code_sha256_prefix":"f9d164903ef08d0c","entry":"_adaptive_params","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9d164903ef08d0c"}},{"code_sha256_prefix":"000102c326bfc425","entry":"_coerce_inputs","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"000102c326bfc425"}},{"code_sha256_prefix":"54093043dc722691","entry":"_cv_scores","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"54093043dc722691"}},{"code_sha256_prefix":"90bb6831eb7433f8","entry":"_cv_scores_ood","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"90bb6831eb7433f8"}},{"code_sha256_prefix":"e987a86942eaaef7","entry":"_param_label","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e987a86942eaaef7"}},{"code_sha256_prefix":"f407e35eb0cd1163","entry":"_params_to_filename","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f407e35eb0cd1163"}},{"code_sha256_prefix":"369f916506c2feb2","entry":"_reduce_features","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"369f916506c2feb2"}},{"code_sha256_prefix":"234f6411b51d431e","entry":"load_tabfn_model","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"234f6411b51d431e"}},{"code_sha256_prefix":"9c060c8d27a0128b","entry":"open_and_filter","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9c060c8d27a0128b"}},{"code_sha256_prefix":"794a870e1843e495","entry":"presence_abundance_filter","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"794a870e1843e495"}},{"code_sha256_prefix":"bc2888b76dd18239","entry":"presence_abundance_filter_per_class","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc2888b76dd18239"}},{"code_sha256_prefix":"195aa4ba088809dc","entry":"Benchmarker","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"195aa4ba088809dc"}},{"code_sha256_prefix":"5e07f4c9a857174a","entry":"DataGenerator","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e07f4c9a857174a"}},{"code_sha256_prefix":"f0cc3b2498455251","entry":"DataLoader","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f0cc3b2498455251"}},{"code_sha256_prefix":"c262e37a31a52c4b","entry":"PerturbationVisualizer","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c262e37a31a52c4b"}},{"code_sha256_prefix":"56be4578f0db8775","entry":"SparsityPerturbation","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"56be4578f0db8775"}},{"code_sha256_prefix":"98e1b933fd7703fb","entry":"open_pasolli","repo":"UMMISCO/metagenomics-fm","repo_kind":"found_in_text","path":"benchmarking/benchmarking.py","file_url":"https://github.com/UMMISCO/metagenomics-fm/blob/HEAD/benchmarking/benchmarking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"98e1b933fd7703fb"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}