{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/operator-learning-with-gaussian-processes","title":"Operator Learning with Gaussian Processes","arxiv_id":"2409.04538","date":"2024-09-06","proceeding":null,"authors":["Carlos Mora","Amin Yousefpour","Shirin Hosseinmardi","Houman Owhadi","Ramin Bostanabad"],"abstract":"Operator learning focuses on approximating mappings $\\mathcal{G}^\\dagger:\\mathcal{U} \\rightarrow\\mathcal{V}$ between infinite-dimensional spaces of functions, such as $u: \\Omega_u\\rightarrow\\mathbb{R}$ and $v: \\Omega_v\\rightarrow\\mathbb{R}$. This makes it particularly suitable for solving parametric nonlinear partial differential equations (PDEs). While most machine learning methods for operator learning rely on variants of deep neural networks (NNs), recent studies have shown that Gaussian Processes (GPs) are also competitive while offering interpretability and theoretical guarantees. In this paper, we introduce a hybrid GP/NN-based framework for operator learning that leverages the strengths of both methods. Instead of approximating the function-valued operator $\\mathcal{G}^\\dagger$, we use a GP to approximate its associated real-valued bilinear form $\\widetilde{\\mathcal{G}}^\\dagger: \\mathcal{U}\\times\\mathcal{V}^*\\rightarrow\\mathbb{R}.$ This bilinear form is defined by $\\widetilde{\\mathcal{G}}^\\dagger(u,\\varphi) := [\\varphi,\\mathcal{G}^\\dagger(u)],$ which allows us to recover the operator $\\mathcal{G}^\\dagger$ through $\\mathcal{G}^\\dagger(u)(y)=\\widetilde{\\mathcal{G}}^\\dagger(u,\\delta_y).$ The GP mean function can be zero or parameterized by a neural operator and for each setting we develop a robust training mechanism based on maximum likelihood estimation (MLE) that can optionally leverage the physics involved. Numerical benchmarks show that (1) it improves the performance of a base neural operator by using it as the mean function of a GP, and (2) it enables zero-shot data-driven models for accurate predictions without prior training. Our framework also handles multi-output operators where $\\mathcal{G}^\\dagger:\\mathcal{U} \\rightarrow\\prod_{s=1}^S\\mathcal{V}^s$, and benefits from computational speed-ups via product kernel structures and Kronecker product matrix representations.","url_abs":"https://arxiv.org/abs/2409.04538v1","url_pdf":"https://arxiv.org/pdf/2409.04538v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"operator-learning-with-gaussian-processes","repo_url":"https://github.com/bostanabad-research-group/gp-for-operator-learning","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"gaussian-processes","task_name":"Gaussian Processes"},{"task_slug":"operator-learning","task_name":"Operator learning"}],"methods":[{"method_slug":"base","method_name":"BASE"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.04538","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.04538"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bostanabad-research-group/gp-for-operator-learning","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4c072813f318c448","entry":"interpolate_grid","repo":"bostanabad-research-group/gp-for-operator-learning","repo_kind":"official","path":"Data-driven/utils/utils_data.py","file_url":"https://github.com/bostanabad-research-group/gp-for-operator-learning/blob/HEAD/Data-driven/utils/utils_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c072813f318c448"}},{"code_sha256_prefix":"204b54b42c7deb11","entry":"unique_idx_in_order","repo":"bostanabad-research-group/gp-for-operator-learning","repo_kind":"official","path":"Data-driven/utils/utils_data.py","file_url":"https://github.com/bostanabad-research-group/gp-for-operator-learning/blob/HEAD/Data-driven/utils/utils_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"204b54b42c7deb11"}},{"code_sha256_prefix":"1ce7ff6dda0ca2a2","entry":"unique_rows_in_order","repo":"bostanabad-research-group/gp-for-operator-learning","repo_kind":"official","path":"Data-driven/GP/models/GP_Advection.py","file_url":"https://github.com/bostanabad-research-group/gp-for-operator-learning/blob/HEAD/Data-driven/GP/models/GP_Advection.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ce7ff6dda0ca2a2"}},{"code_sha256_prefix":"75efe8f13aced9c9","entry":"load","repo":"bostanabad-research-group/gp-for-operator-learning","repo_kind":"official","path":"Data-driven/utils/utils_data.py","file_url":"https://github.com/bostanabad-research-group/gp-for-operator-learning/blob/HEAD/Data-driven/utils/utils_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75efe8f13aced9c9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}