{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/vectorized-conditional-neural-fields-a","title":"Vectorized Conditional Neural Fields: A Framework for Solving Time-dependent Parametric Partial Differential Equations","arxiv_id":"2406.03919","date":"2024-06-06","proceeding":null,"authors":["Jan Hagnberger","Marimuthu Kalimuthu","Daniel Musekamp","Mathias Niepert"],"abstract":"Transformer models are increasingly used for solving Partial Differential Equations (PDEs). Several adaptations have been proposed, all of which suffer from the typical problems of Transformers, such as quadratic memory and time complexity. Furthermore, all prevalent architectures for PDE solving lack at least one of several desirable properties of an ideal surrogate model, such as (i) generalization to PDE parameters not seen during training, (ii) spatial and temporal zero-shot super-resolution, (iii) continuous temporal extrapolation, (iv) support for 1D, 2D, and 3D PDEs, and (v) efficient inference for longer temporal rollouts. To address these limitations, we propose Vectorized Conditional Neural Fields (VCNeFs), which represent the solution of time-dependent PDEs as neural fields. Contrary to prior methods, however, VCNeFs compute, for a set of multiple spatio-temporal query points, their solutions in parallel and model their dependencies through attention mechanisms. Moreover, VCNeF can condition the neural field on both the initial conditions and the parameters of the PDEs. An extensive set of experiments demonstrates that VCNeFs are competitive with and often outperform existing ML-based surrogate models.","url_abs":"https://arxiv.org/abs/2406.03919v2","url_pdf":"https://arxiv.org/pdf/2406.03919v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"vectorized-conditional-neural-fields-a","repo_url":"https://github.com/jhagnberger/vcnef","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"super-resolution","task_name":"Super-Resolution"}],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.03919","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.03919"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/jhagnberger/vcnef","reach":null}],"summary":{"ran":9,"unverified":5},"by_repo_kind":{"official":{"samples":14,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2425561dee53dea9","entry":"ActivationFunctionFeatureMap","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2425561dee53dea9"}},{"code_sha256_prefix":"de193a78579a115b","entry":"AttentionLayer","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de193a78579a115b"}},{"code_sha256_prefix":"42c734db837c5c4f","entry":"BaseMask","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42c734db837c5c4f"}},{"code_sha256_prefix":"7811357b2c1e5fe9","entry":"FullMask","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7811357b2c1e5fe9"}},{"code_sha256_prefix":"f11fc050ba41fb3f","entry":"LengthMask","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f11fc050ba41fb3f"}},{"code_sha256_prefix":"7d875f9be7f69c72","entry":"ModulatedNeuralField","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d875f9be7f69c72"}},{"code_sha256_prefix":"ba00ba0ba2965717","entry":"VCNeF","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ba00ba0ba2965717"}},{"code_sha256_prefix":"072598f37708bf8d","entry":"VectorizedAttentionLayer","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"072598f37708bf8d"}},{"code_sha256_prefix":"fbf3776a0b662b3c","entry":"VectorizedLinearAttention","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fbf3776a0b662b3c"}},{"code_sha256_prefix":"ccb3e8eb10824cdd","entry":"LinearAttention","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ccb3e8eb10824cdd"}},{"code_sha256_prefix":"6b0304ea3035f01e","entry":"TransformerEncoder","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6b0304ea3035f01e"}},{"code_sha256_prefix":"87230930da2c54a6","entry":"TransformerEncoderLayer","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87230930da2c54a6"}},{"code_sha256_prefix":"03d629220e9dbb5f","entry":"VCNeFLayer","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"03d629220e9dbb5f"}},{"code_sha256_prefix":"feff4c47d3fd6c26","entry":"VCNeFModel","repo":"jhagnberger/vcnef","repo_kind":"official","path":"vcnef/vcnef_1d.py","file_url":"https://github.com/jhagnberger/vcnef/blob/HEAD/vcnef/vcnef_1d.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"feff4c47d3fd6c26"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}