{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-02889","title":"Rethinking Forward Processes for Score-Based Nonlinear Data Assimilation in High Dimensions","arxiv_id":"2604.02889","date":"2026-04-03","proceeding":null,"authors":["Eunbi Yoon","Won Chang","Donghan Kim","Dae Wook Kim"],"abstract":"Data assimilation is the process of estimating the state of a dynamical system over time by combining model predictions with measurements. This task becomes challenging when the system is nonlinear and high-dimensional. To address this, score-based Bayesian filters have recently emerged. However, these methods still show unsatisfactory performance in certain cases, particularly under spatially sparse measurements. Such degradation stems from heuristic approximations of the likelihood score, whose errors can accumulate over time. This limitation arises because the methods simply adopt a classical forward process for generative modeling that transforms a data distribution toward a Gaussian distribution, which is independent of the measurement equation. Here, we propose a forward process tailored for filtering that transforms the system state toward the measurement space, enabling a theoretically sound formulation of the likelihood score. Based on this, we develop the Measurement-Aware Score-based Filter (MASF). We evaluate MASF on Kolmogorov flow, a high-dimensional fluid benchmark with up to $\\mathcal{O}(10^5)$ dimensions, under diverse measurement operators, including nonlinear cases with a dimensional mismatch between the state and the measurements. MASF shows improved performance over existing score-based filters and ensemble-type Kalman filters. Notably, MASF achieves up to a $28.2\\times$ wall-clock speedup compared with the baselines when using amortized pretraining. Our implementation is available at \\texttt{https://github.com/tcnllab-oss/masf}.","url_abs":"https://arxiv.org/abs/2604.02889","url_pdf":"https://arxiv.org/pdf/2604.02889","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2604.02889","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.02889"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/tcnllab-oss/masf","reach":null}],"summary":{"ran_draft_wrong":4,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":7,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"526deb69188634cd","entry":"a","repo":"tcnllab-oss/masf","repo_kind":"found_in_text","path":"methods/nonlinear_ours.py","file_url":"https://github.com/tcnllab-oss/masf/blob/HEAD/methods/nonlinear_ours.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"526deb69188634cd"}},{"code_sha256_prefix":"dbd595a711010351","entry":"cosine_log_alpha","repo":"tcnllab-oss/masf","repo_kind":"found_in_text","path":"methods/nonlinear_ours.py","file_url":"https://github.com/tcnllab-oss/masf/blob/HEAD/methods/nonlinear_ours.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dbd595a711010351"}},{"code_sha256_prefix":"cac3b89f3ed38ae7","entry":"guidance_scale_fn","repo":"tcnllab-oss/masf","repo_kind":"found_in_text","path":"methods/nonlinear_ours.py","file_url":"https://github.com/tcnllab-oss/masf/blob/HEAD/methods/nonlinear_ours.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cac3b89f3ed38ae7"}},{"code_sha256_prefix":"314efaaa684244f1","entry":"score_scale_fn","repo":"tcnllab-oss/masf","repo_kind":"found_in_text","path":"methods/nonlinear_ours.py","file_url":"https://github.com/tcnllab-oss/masf/blob/HEAD/methods/nonlinear_ours.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"314efaaa684244f1"}},{"code_sha256_prefix":"bae40470b4681d3b","entry":"Method","repo":"tcnllab-oss/masf","repo_kind":"found_in_text","path":"methods/nonlinear_ours.py","file_url":"https://github.com/tcnllab-oss/masf/blob/HEAD/methods/nonlinear_ours.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bae40470b4681d3b"}},{"code_sha256_prefix":"0cbc82d2d29cabff","entry":"Nonlinear_Ours","repo":"tcnllab-oss/masf","repo_kind":"found_in_text","path":"methods/nonlinear_ours.py","file_url":"https://github.com/tcnllab-oss/masf/blob/HEAD/methods/nonlinear_ours.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0cbc82d2d29cabff"}},{"code_sha256_prefix":"8c070d2f0cb828b4","entry":"sampler","repo":"tcnllab-oss/masf","repo_kind":"found_in_text","path":"methods/nonlinear_ours.py","file_url":"https://github.com/tcnllab-oss/masf/blob/HEAD/methods/nonlinear_ours.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8c070d2f0cb828b4"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}