{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/weather-5k-a-large-scale-global-station","title":"How far are today's time-series models from real-world weather forecasting applications?","arxiv_id":"2406.14399","date":"2024-06-20","proceeding":null,"authors":["Tao Han","Song Guo","Zhenghao Chen","Wanghan Xu","Lei Bai"],"abstract":"The development of Time-Series Forecasting (TSF) techniques is often hindered by the lack of comprehensive datasets. This is particularly problematic for time-series weather forecasting, where commonly used datasets suffer from significant limitations such as small size, limited temporal coverage, and sparse spatial distribution. These constraints severely impede the optimization and evaluation of TSF models, resulting in benchmarks that are not representative of real-world applications, such as operational weather forecasting. In this work, we introduce the WEATHER-5K dataset, a comprehensive collection of observational weather data that better reflects real-world scenarios. As a result, it enables a better training of models and a more accurate assessment of the real-world forecasting capabilities of TSF models, pushing them closer to in-situ applications. Through extensive benchmarking against operational Numerical Weather Prediction (NWP) models, we provide researchers with a clear assessment of the gap between academic TSF models and real-world weather forecasting applications. This highlights the significant performance disparity between TSF and NWP models by analyzing performance across detailed weather variables, extreme weather event prediction, and model complexity comparison. Finally, we summarise the result into recommendations to the users and highlight potential areas required to facilitate further TSF research. The dataset and benchmark implementation are available at: https://github.com/taohan10200/WEATHER-5K.","url_abs":"https://arxiv.org/abs/2406.14399v2","url_pdf":"https://arxiv.org/pdf/2406.14399v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"weather-5k-a-large-scale-global-station","repo_url":"https://github.com/taohan10200/weather-5k","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"time-series-1","task_name":"Time Series"},{"task_slug":"time-series-forecasting","task_name":"Time Series Forecasting"},{"task_slug":"weather-forecasting","task_name":"Weather Forecasting"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2406.14399","atlas_url":"https://app.syntology.ai/?focus=2406.14399","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.14399"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/taohan10200/weather-5k","reach":null}],"summary":{"ran":16,"unverified":1},"by_repo_kind":{"official":{"samples":17,"ran":16,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c937754010c54537","entry":"AutoCorrelation","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c937754010c54537"}},{"code_sha256_prefix":"2a1cd6852143de94","entry":"CausalBlock","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a1cd6852143de94"}},{"code_sha256_prefix":"bc4b6d85c64832c9","entry":"CausalConv","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc4b6d85c64832c9"}},{"code_sha256_prefix":"5c2a29db14be6a0a","entry":"Chomp1d","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5c2a29db14be6a0a"}},{"code_sha256_prefix":"55d5a3c23533ecf4","entry":"CrossCorrelation","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"55d5a3c23533ecf4"}},{"code_sha256_prefix":"dbc3b380a430e700","entry":"CrossCorrelationLayer","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dbc3b380a430e700"}},{"code_sha256_prefix":"c4a745f5f73145a0","entry":"DataEmbedding","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c4a745f5f73145a0"}},{"code_sha256_prefix":"2601733ce09afb32","entry":"Decoder","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2601733ce09afb32"}},{"code_sha256_prefix":"ba4b7db0656f9fd6","entry":"DecoderLayer","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ba4b7db0656f9fd6"}},{"code_sha256_prefix":"23a94c41f4335756","entry":"Encoder","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"23a94c41f4335756"}},{"code_sha256_prefix":"ed00dfdc4c788366","entry":"EncoderLayer","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ed00dfdc4c788366"}},{"code_sha256_prefix":"3d2068507fa9d360","entry":"GeoPositionalEmbedding","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3d2068507fa9d360"}},{"code_sha256_prefix":"55fc5b1b9eb20a44","entry":"MultiCorrelation","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"55fc5b1b9eb20a44"}},{"code_sha256_prefix":"627811d6e342bdbf","entry":"moving_avg","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"627811d6e342bdbf"}},{"code_sha256_prefix":"bf5431d9a57a906b","entry":"my_Layernorm","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bf5431d9a57a906b"}},{"code_sha256_prefix":"0476441daf861ec1","entry":"series_decomp","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0476441daf861ec1"}},{"code_sha256_prefix":"b8cc3b42dec2929e","entry":"Model","repo":"taohan10200/weather-5k","repo_kind":"official","path":"models/Corrformer.py","file_url":"https://github.com/taohan10200/weather-5k/blob/HEAD/models/Corrformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8cc3b42dec2929e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}