{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/prithvi-wxc-foundation-model-for-weather-and","title":"Prithvi WxC: Foundation Model for Weather and Climate","arxiv_id":"2409.13598","date":"2024-09-20","proceeding":null,"authors":["Johannes Schmude","Sujit Roy","Will Trojak","Johannes Jakubik","Daniel Salles Civitarese","Shraddha Singh","Julian Kuehnert","Kumar Ankur","Aman Gupta","Christopher E Phillips","Romeo Kienzler","Daniela Szwarcman","Vishal Gaur","Rajat Shinde","Rohit Lal","Arlindo Da Silva","Jorge Luis Guevara Diaz","Anne Jones","Simon Pfreundschuh","Amy Lin","Aditi Sheshadri","Udaysankar Nair","Valentine Anantharaj","Hendrik Hamann","Campbell Watson","Manil Maskey","Tsengdar J Lee","Juan Bernabe Moreno","Rahul Ramachandran"],"abstract":"Triggered by the realization that AI emulators can rival the performance of traditional numerical weather prediction models running on HPC systems, there is now an increasing number of large AI models that address use cases such as forecasting, downscaling, or nowcasting. While the parallel developments in the AI literature focus on foundation models -- models that can be effectively tuned to address multiple, different use cases -- the developments on the weather and climate side largely focus on single-use cases with particular emphasis on mid-range forecasting. We close this gap by introducing Prithvi WxC, a 2.3 billion parameter foundation model developed using 160 variables from the Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2). Prithvi WxC employs an encoder-decoder-based architecture, incorporating concepts from various recent transformer models to effectively capture both regional and global dependencies in the input data. The model has been designed to accommodate large token counts to model weather phenomena in different topologies at fine resolutions. Furthermore, it is trained with a mixed objective that combines the paradigms of masked reconstruction with forecasting. We test the model on a set of challenging downstream tasks namely: Autoregressive rollout forecasting, Downscaling, Gravity wave flux parameterization, and Extreme events estimation. The pretrained model with 2.3 billion parameters, along with the associated fine-tuning workflows, has been publicly released as an open-source contribution via Hugging Face.","url_abs":"https://arxiv.org/abs/2409.13598v1","url_pdf":"https://arxiv.org/pdf/2409.13598v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"prithvi-wxc-foundation-model-for-weather-and","repo_url":"https://github.com/nasa-impact/gravity-wave-finetuning","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"prithvi-wxc-foundation-model-for-weather-and","repo_url":"https://github.com/nasa-impact/prithvi-wxc","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"model","task_name":"model"}],"methods":[{"method_slug":"focus","method_name":"Focus"},{"method_slug":"gravity","method_name":"Gravity"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2409.13598","atlas_url":"https://app.syntology.ai/?focus=2409.13598","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.13598"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nasa-impact/prithvi-wxc","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nasa-impact/gravity-wave-finetuning","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":11,"unverified":5},"by_repo_kind":{"official":{"samples":16,"ran":11,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1ac0e11ab2da4463","entry":"count_forward_pass_parameters","repo":"nasa-impact/gravity-wave-finetuning","repo_kind":"official","path":"finetune_gravity_wave.py","file_url":"https://github.com/nasa-impact/gravity-wave-finetuning/blob/HEAD/finetune_gravity_wave.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ac0e11ab2da4463"}},{"code_sha256_prefix":"9fb52d0e32d427ed","entry":"drop_path","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/model.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9fb52d0e32d427ed"}},{"code_sha256_prefix":"066475619b6acbb7","entry":"filename_to_date","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/download.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/download.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"066475619b6acbb7"}},{"code_sha256_prefix":"6662c7e1640fbbb9","entry":"get_dynamic_variable_name","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/definitions.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/definitions.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6662c7e1640fbbb9"}},{"code_sha256_prefix":"774e1b2aa38d73c7","entry":"get_previous_file","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/download.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/download.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"774e1b2aa38d73c7"}},{"code_sha256_prefix":"e1e8a2e1c4e3c86f","entry":"hash_tensor","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"validation/reproducibility.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/validation/reproducibility.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1e8a2e1c4e3c86f"}},{"code_sha256_prefix":"f71f1d308daf9e10","entry":"init_ddp","repo":"nasa-impact/gravity-wave-finetuning","repo_kind":"official","path":"distributed.py","file_url":"https://github.com/nasa-impact/gravity-wave-finetuning/blob/HEAD/distributed.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f71f1d308daf9e10"}},{"code_sha256_prefix":"b8729ac178754181","entry":"input_scalers","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/dataloaders/merra2.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/dataloaders/merra2.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8729ac178754181"}},{"code_sha256_prefix":"4c8757e89e12c5ab","entry":"rollout_iter","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/rollout.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/rollout.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c8757e89e12c5ab"}},{"code_sha256_prefix":"99730589757d09b9","entry":"static_input_scalers","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/dataloaders/merra2.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/dataloaders/merra2.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"99730589757d09b9"}},{"code_sha256_prefix":"9f1f476791621b91","entry":"validate_inputs","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"validation/reproducibility.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/validation/reproducibility.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9f1f476791621b91"}},{"code_sha256_prefix":"2766c2ad4c432442","entry":"get_config","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"validation/config.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/validation/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2766c2ad4c432442"}},{"code_sha256_prefix":"eeaa739555b6a20c","entry":"get_static_variable_name","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/definitions.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/definitions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eeaa739555b6a20c"}},{"code_sha256_prefix":"e1078dd468c68f99","entry":"masked_inference","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"PrithviWxC/model.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/PrithviWxC/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1078dd468c68f99"}},{"code_sha256_prefix":"f19b431b08711c96","entry":"model_distribute","repo":"nasa-impact/gravity-wave-finetuning","repo_kind":"official","path":"distributed.py","file_url":"https://github.com/nasa-impact/gravity-wave-finetuning/blob/HEAD/distributed.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f19b431b08711c96"}},{"code_sha256_prefix":"8eb3852c7ab1b5a7","entry":"preproc","repo":"nasa-impact/prithvi-wxc","repo_kind":"official","path":"validation/validate_prithvi_wxc.py","file_url":"https://github.com/nasa-impact/prithvi-wxc/blob/HEAD/validation/validate_prithvi_wxc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8eb3852c7ab1b5a7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}