{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/in-context-operator-learning-for-differential","title":"In-Context Operator Learning with Data Prompts for Differential Equation Problems","arxiv_id":"2304.07993","date":"2023-04-17","proceeding":null,"authors":["Liu Yang","Siting Liu","Tingwei Meng","Stanley J. Osher"],"abstract":"This paper introduces a new neural-network-based approach, namely In-Context Operator Networks (ICON), to simultaneously learn operators from the prompted data and apply it to new questions during the inference stage, without any weight update. Existing methods are limited to using a neural network to approximate a specific equation solution or a specific operator, requiring retraining when switching to a new problem with different equations. By training a single neural network as an operator learner, we can not only get rid of retraining (even fine-tuning) the neural network for new problems, but also leverage the commonalities shared across operators so that only a few demos in the prompt are needed when learning a new operator. Our numerical results show the neural network's capability as a few-shot operator learner for a diversified type of differential equation problems, including forward and inverse problems of ordinary differential equations (ODEs), partial differential equations (PDEs), and mean-field control (MFC) problems, and also show that it can generalize its learning capability to operators beyond the training distribution.","url_abs":"https://arxiv.org/abs/2304.07993v3","url_pdf":"https://arxiv.org/pdf/2304.07993v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"in-context-operator-learning-for-differential","repo_url":"https://github.com/liuyangmage/in-context-operator-networks","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"in-context-operator-learning-for-differential","repo_url":"https://github.com/LiuYangMage/in-context-operator-networks/tree/main/icon","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"operator-learning","task_name":"Operator learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2304.07993","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2304.07993"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/liuyangmage/in-context-operator-networks","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/LiuYangMage/in-context-operator-networks/tree/main/icon","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"ran":2,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ea1821fedc537073","entry":"append_dict_list","repo":"LiuYangMage/in-context-operator-networks","repo_kind":"official","path":"icon-lm/operator_weno/analysis.py","file_url":"https://github.com/LiuYangMage/in-context-operator-networks/blob/HEAD/icon-lm/operator_weno/analysis.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea1821fedc537073"}},{"code_sha256_prefix":"ccc3d008753c19f3","entry":"get_error","repo":"LiuYangMage/in-context-operator-networks","repo_kind":"official","path":"icon-lm/operator_weno/analysis_plot.py","file_url":"https://github.com/LiuYangMage/in-context-operator-networks/blob/HEAD/icon-lm/operator_weno/analysis_plot.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ccc3d008753c19f3"}},{"code_sha256_prefix":"53e1fee72ab7a268","entry":"get_error_tune","repo":"LiuYangMage/in-context-operator-networks","repo_kind":"official","path":"icon-lm/operator_weno/analysis_plot.py","file_url":"https://github.com/LiuYangMage/in-context-operator-networks/blob/HEAD/icon-lm/operator_weno/analysis_plot.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53e1fee72ab7a268"}},{"code_sha256_prefix":"c4bac98236c1fc2c","entry":"load_tf_weights_in_gpt2","repo":"LiuYangMage/in-context-operator-networks","repo_kind":"official","path":"icon-lm/models_gpt2_source.py","file_url":"https://github.com/LiuYangMage/in-context-operator-networks/blob/HEAD/icon-lm/models_gpt2_source.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4bac98236c1fc2c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}