{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-15511","title":"OgBench: A Framework for Evaluating Graph Neural Networks on Omics Data","arxiv_id":"2605.15511","date":"2026-05-15","proceeding":null,"authors":["Louisa Cornelis","Johan Mathe","Louis Van Langendonck","Guillermo Bernárdez","Nina Miolane"],"abstract":"Graph Neural Networks (GNNs) have become the dominant framework for inductive graph-level learning. Yet most benchmarks focus on the regime $n \\gg p$, where the number of graphs $n$ greatly exceeds the number of nodes per graph $p$. This overlooks biological domains such as omics, which operate in the opposite $n \\ll p$ regime, characterized by large graphs of genes, transcripts, or proteins across few patient samples. This raises the question: \\textit{how do GNNs perform in this low-sample, high-node omics setting?} We introduce \\texttt{OgBench} (Omics-Graph Bench), the first benchmarking platform for graph-level prediction in the $n \\ll p$ regime characteristic of omics data. We provide a standardized, end-to-end modular infrastructure from raw omics data to families of featured graphs with varied structural properties. We benchmark classical GNNs, as well as GNNs designed for large graphs and omics applications, alongside MLPs and machine learning baselines to establish reference performances. Our results show that widely used GNNs often do not outperform simple MLPs and classical baselines. These findings challenge the prevailing assumption that graph structure inherently adds value in this domain, fostering a critical reassessment of current learning paradigms. Ultimately, by exposing these limitations, OgBench provides the open-source ecosystem necessary for the community to develop and validate novel architectures explicitly tailored for biological graphs. The code is available at https://github.com/geometric-intelligence/ogbench.","url_abs":"https://arxiv.org/abs/2605.15511","url_pdf":"https://arxiv.org/pdf/2605.15511","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.15511","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.15511"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/geometric-intelligence/ogbench","reach":null}],"summary":{"ran":2,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"aa87943510d705b0","entry":"EfficientGPSConv","repo":"geometric-intelligence/ogbench","repo_kind":"found_in_text","path":"ogbench/nn/backbones/graph/gps.py","file_url":"https://github.com/geometric-intelligence/ogbench/blob/HEAD/ogbench/nn/backbones/graph/gps.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa87943510d705b0"}},{"code_sha256_prefix":"649172b502be56ff","entry":"RedrawProjection","repo":"geometric-intelligence/ogbench","repo_kind":"found_in_text","path":"ogbench/nn/backbones/graph/gps.py","file_url":"https://github.com/geometric-intelligence/ogbench/blob/HEAD/ogbench/nn/backbones/graph/gps.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"649172b502be56ff"}},{"code_sha256_prefix":"8c9362197e225d41","entry":"GPSEncoder","repo":"geometric-intelligence/ogbench","repo_kind":"found_in_text","path":"ogbench/nn/backbones/graph/gps.py","file_url":"https://github.com/geometric-intelligence/ogbench/blob/HEAD/ogbench/nn/backbones/graph/gps.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c9362197e225d41"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}