{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2510-18707","title":"OmniCast: A Masked Latent Diffusion Model for Weather Forecasting Across Time Scales","arxiv_id":"2510.18707","date":"2025-10-20","proceeding":"NeurIPS","authors":["Tung Nguyen","Tuan Pham","Troy Arcomano","Veerabhadra Kotamarthi","Ian Foster","Sandeep Madireddy","Aditya Grover"],"abstract":"Accurate weather forecasting across time scales is critical for anticipating and mitigating the impacts of climate change. Recent data-driven methods based on deep learning have achieved significant success in the medium range, but struggle at longer subseasonal-to-seasonal (S2S) horizons due to error accumulation in their autoregressive approach. In this work, we propose OmniCast, a scalable and skillful probabilistic model that unifies weather forecasting across timescales. OmniCast consists of two components: a VAE model that encodes raw weather data into a continuous, lower-dimensional latent space, and a diffusion-based transformer model that generates a sequence of future latent tokens given the initial conditioning tokens. During training, we mask random future tokens and train the transformer to estimate their distribution given conditioning and visible tokens using a per-token diffusion head. During inference, the transformer generates the full sequence of future tokens by iteratively unmasking random subsets of tokens. This joint sampling across space and time mitigates compounding errors from autoregressive approaches. The low-dimensional latent space enables modeling long sequences of future latent states, allowing the transformer to learn weather dynamics beyond initial conditions. OmniCast performs competitively with leading probabilistic methods at the medium-range timescale while being 10x to 20x faster, and achieves state-of-the-art performance at the subseasonal-to-seasonal scale across accuracy, physics-based, and probabilistic metrics. Furthermore, we demonstrate that OmniCast can generate stable rollouts up to 100 years ahead. Code and model checkpoints are available at https://github.com/tung-nd/omnicast.","url_abs":"https://arxiv.org/abs/2510.18707","url_pdf":"https://arxiv.org/pdf/2510.18707","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2510.18707","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2510.18707"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/tung-nd/omnicast","reach":null}],"summary":{"ran":2,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"5d512f803a119b74","entry":"Decoder","repo":"tung-nd/omnicast","repo_kind":"found_in_text","path":"weather_mae/models/vaes/continuous_vae_unet.py","file_url":"https://github.com/tung-nd/omnicast/blob/HEAD/weather_mae/models/vaes/continuous_vae_unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5d512f803a119b74"}},{"code_sha256_prefix":"0586bd6c97ff2163","entry":"DiagonalGaussianDistribution","repo":"tung-nd/omnicast","repo_kind":"found_in_text","path":"weather_mae/models/vaes/continuous_vae_unet.py","file_url":"https://github.com/tung-nd/omnicast/blob/HEAD/weather_mae/models/vaes/continuous_vae_unet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0586bd6c97ff2163"}},{"code_sha256_prefix":"ee94bf6e8ce274b0","entry":"Encoder","repo":"tung-nd/omnicast","repo_kind":"found_in_text","path":"weather_mae/models/vaes/continuous_vae_unet.py","file_url":"https://github.com/tung-nd/omnicast/blob/HEAD/weather_mae/models/vaes/continuous_vae_unet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ee94bf6e8ce274b0"}},{"code_sha256_prefix":"c3415f3f365f93ee","entry":"KLVAEUnet","repo":"tung-nd/omnicast","repo_kind":"found_in_text","path":"weather_mae/models/vaes/continuous_vae_unet.py","file_url":"https://github.com/tung-nd/omnicast/blob/HEAD/weather_mae/models/vaes/continuous_vae_unet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c3415f3f365f93ee"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_api"},"syntology_extracted_results":null}