{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/poseidon-efficient-foundation-models-for-pdes","title":"Poseidon: Efficient Foundation Models for PDEs","arxiv_id":"2405.19101","date":"2024-05-29","proceeding":null,"authors":["Maximilian Herde","Bogdan Raonić","Tobias Rohner","Roger Käppeli","Roberto Molinaro","Emmanuel de Bézenac","Siddhartha Mishra"],"abstract":"We introduce Poseidon, a foundation model for learning the solution operators of PDEs. It is based on a multiscale operator transformer, with time-conditioned layer norms that enable continuous-in-time evaluations. A novel training strategy leveraging the semi-group property of time-dependent PDEs to allow for significant scaling-up of the training data is also proposed. Poseidon is pretrained on a diverse, large scale dataset for the governing equations of fluid dynamics. It is then evaluated on a suite of 15 challenging downstream tasks that include a wide variety of PDE types and operators. We show that Poseidon exhibits excellent performance across the board by outperforming baselines significantly, both in terms of sample efficiency and accuracy. Poseidon also generalizes very well to new physics that is not seen during pretraining. Moreover, Poseidon scales with respect to model and data size, both for pretraining and for downstream tasks. Taken together, our results showcase the surprising ability of Poseidon to learn effective representations from a very small set of PDEs during pretraining in order to generalize well to unseen and unrelated PDEs downstream, demonstrating its potential as an effective, general purpose PDE foundation model. Finally, the Poseidon model as well as underlying pretraining and downstream datasets are open sourced, with code being available at https://github.com/camlab-ethz/poseidon and pretrained models and datasets at https://huggingface.co/camlab-ethz.","url_abs":"https://arxiv.org/abs/2405.19101v2","url_pdf":"https://arxiv.org/pdf/2405.19101v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"poseidon-efficient-foundation-models-for-pdes","repo_url":"https://github.com/camlab-ethz/poseidon","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"poseidon-efficient-foundation-models-for-pdes","repo_url":"https://github.com/bogdanraonic3/convolutionalneuraloperator","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"operator-learning","task_name":"Operator learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2405.19101","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.19101"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/camlab-ethz/poseidon","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bogdanraonic3/convolutionalneuraloperator","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"ran_violates":1},"by_repo_kind":{"listed":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"75d818b6a2b255ce","entry":"activation","repo":"bogdanraonic3/convolutionalneuraloperator","repo_kind":"listed","path":"_OtherModels/DeepONetModules.py","file_url":"https://github.com/bogdanraonic3/convolutionalneuraloperator/blob/HEAD/_OtherModels/DeepONetModules.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75d818b6a2b255ce"}},{"code_sha256_prefix":"77016bf273471ae3","entry":"activation","repo":"bogdanraonic3/convolutionalneuraloperator","repo_kind":"listed","path":"_OtherModels/GeneralModules.py","file_url":"https://github.com/bogdanraonic3/convolutionalneuraloperator/blob/HEAD/_OtherModels/GeneralModules.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"77016bf273471ae3"}},{"code_sha256_prefix":"6ba8cee9f5daea41","entry":"pair","repo":"bogdanraonic3/convolutionalneuraloperator","repo_kind":"listed","path":"CNO2d_temporal/CNO_timeModule_CIN.py","file_url":"https://github.com/bogdanraonic3/convolutionalneuraloperator/blob/HEAD/CNO2d_temporal/CNO_timeModule_CIN.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6ba8cee9f5daea41"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}