{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hr-extreme-a-high-resolution-dataset-for","title":"HR-Extreme: A High-Resolution Dataset for Extreme Weather Forecasting","arxiv_id":"2409.18885","date":"2024-09-27","proceeding":null,"authors":["Nian Ran","Peng Xiao","Yue Wang","Wesley Shi","Jianxin Lin","Qi Meng","Richard Allmendinger"],"abstract":"The application of large deep learning models in weather forecasting has led to significant advancements in the field, including higher-resolution forecasting and extended prediction periods exemplified by models such as Pangu and Fuxi. Despite these successes, previous research has largely been characterized by the neglect of extreme weather events, and the availability of datasets specifically curated for such events remains limited. Given the critical importance of accurately forecasting extreme weather, this study introduces a comprehensive dataset that incorporates high-resolution extreme weather cases derived from the High-Resolution Rapid Refresh (HRRR) data, a 3-km real-time dataset provided by NOAA. We also evaluate the current state-of-the-art deep learning models and Numerical Weather Prediction (NWP) systems on HR-Extreme, and provide a improved baseline deep learning model called HR-Heim which has superior performance on both general loss and HR-Extreme compared to others. Our results reveal that the errors of extreme weather cases are significantly larger than overall forecast error, highlighting them as an crucial source of loss in weather prediction. These findings underscore the necessity for future research to focus on improving the accuracy of extreme weather forecasts to enhance their practical utility.","url_abs":"https://arxiv.org/abs/2409.18885v1","url_pdf":"https://arxiv.org/pdf/2409.18885v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hr-extreme-a-high-resolution-dataset-for","repo_url":"https://github.com/HuskyNian/HR-Extreme","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"deep-learning","task_name":"Deep Learning"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"weather-forecasting","task_name":"Weather Forecasting"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2409.18885","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.18885"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/HuskyNian/HR-Extreme","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":4,"ran":1,"unverified":4},"by_repo_kind":{"official":{"samples":9,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"902272dc88cd4927","entry":"adjust_end_date","repo":"huskynian/hr-extreme","repo_kind":"official","path":"make_datasetall.py","file_url":"https://github.com/huskynian/hr-extreme/blob/HEAD/make_datasetall.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"902272dc88cd4927"}},{"code_sha256_prefix":"b64136a94f3d31ea","entry":"crop_images","repo":"huskynian/hr-extreme","repo_kind":"official","path":"make_dataset_by_index_file.py","file_url":"https://github.com/huskynian/hr-extreme/blob/HEAD/make_dataset_by_index_file.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b64136a94f3d31ea"}},{"code_sha256_prefix":"3f37e127f308d433","entry":"fix_type","repo":"huskynian/hr-extreme","repo_kind":"official","path":"make_datasetall.py","file_url":"https://github.com/huskynian/hr-extreme/blob/HEAD/make_datasetall.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3f37e127f308d433"}},{"code_sha256_prefix":"121aa467fbff56dc","entry":"get_cropped_images","repo":"huskynian/hr-extreme","repo_kind":"official","path":"make_dataset_by_index_file.py","file_url":"https://github.com/huskynian/hr-extreme/blob/HEAD/make_dataset_by_index_file.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"121aa467fbff56dc"}},{"code_sha256_prefix":"f9c4f3fad479c0f6","entry":"get_extreme_cases","repo":"HuskyNian/HR-Extreme","repo_kind":"official","path":"make_dataset3.py","file_url":"https://github.com/HuskyNian/HR-Extreme/blob/HEAD/make_dataset3.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f9c4f3fad479c0f6"}},{"code_sha256_prefix":"cab57243cc6520cb","entry":"get_date_range","repo":"huskynian/hr-extreme","repo_kind":"official","path":"make_dataset_by_index_file.py","file_url":"https://github.com/huskynian/hr-extreme/blob/HEAD/make_dataset_by_index_file.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cab57243cc6520cb"}},{"code_sha256_prefix":"c9c5fe4ac86a7698","entry":"load_variable","repo":"huskynian/hr-extreme","repo_kind":"official","path":"make_nwp_predictions.py","file_url":"https://github.com/huskynian/hr-extreme/blob/HEAD/make_nwp_predictions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c9c5fe4ac86a7698"}},{"code_sha256_prefix":"bbe20f9bae201132","entry":"make_dataset1","repo":"HuskyNian/HR-Extreme","repo_kind":"official","path":"make_dataset1.py","file_url":"https://github.com/HuskyNian/HR-Extreme/blob/HEAD/make_dataset1.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bbe20f9bae201132"}},{"code_sha256_prefix":"5dff6859dea944a2","entry":"make_dataset3","repo":"HuskyNian/HR-Extreme","repo_kind":"official","path":"make_dataset3.py","file_url":"https://github.com/HuskyNian/HR-Extreme/blob/HEAD/make_dataset3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5dff6859dea944a2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}