{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-10410","title":"Effective Dataset Distillation for Spatio-Temporal Forecasting with Bi-dimensional Compression","arxiv_id":"2603.10410","date":"2026-03-11","proceeding":null,"authors":["Taehyung Kwon","Yeonje Choi","Yeongho Kim","Kijung Shin"],"abstract":"Spatio-temporal time series are widely used in real-world applications, including traffic prediction and weather forecasting. They are sequences of observations over extensive periods and multiple locations, naturally represented as multidimensional data. Forecasting is a central task in spatio-temporal analysis, and numerous deep learning methods have been developed to address it. However, as dataset sizes and model complexities continue to grow in practice, training deep learning models has become increasingly time- and resource-intensive. A promising solution to this challenge is dataset distillation, which synthesizes compact datasets that can effectively replace the original data for model training. Although successful in various domains, including time series analysis, existing dataset distillation methods compress only one dimension, making them less suitable for spatio-temporal datasets, where both spatial and temporal dimensions jointly contribute to the large data volume. To address this limitation, we propose STemDist, the first dataset distillation method specialized for spatio-temporal time series forecasting. A key idea of our solution is to compress both temporal and spatial dimensions in a balanced manner, reducing training time and memory. We further reduce the distillation cost by performing distillation at the cluster level rather than the individual location level, and we complement this coarse-grained approach with a subset-based granular distillation technique that enhances forecasting performance. On five real-world datasets, we show empirically that, compared to both general and time-series dataset distillation methods, datasets distilled by our STemDist method enable model training (1) faster (up to 6X) (2) more memory-efficient (up to 8X), and (3) more effective (with up to 12% lower prediction error).","url_abs":"https://arxiv.org/abs/2603.10410","url_pdf":"https://arxiv.org/pdf/2603.10410","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2603.10410","atlas_url":"https://app.syntology.ai/?focus=2603.10410","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.10410"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/kbrother/STemDist","reach":null}],"summary":{"unverified":4},"by_repo_kind":{"found_in_text":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"fc5d5bcedbdd5b5a","entry":"TSFE_backbone","repo":"kbrother/STemDist","repo_kind":"found_in_text","path":"TimeDC/layers/stdistillation_backbone.py","file_url":"https://github.com/kbrother/STemDist/blob/HEAD/TimeDC/layers/stdistillation_backbone.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fc5d5bcedbdd5b5a"}},{"code_sha256_prefix":"e3e8f800d1b05bf7","entry":"TSTEncoder","repo":"kbrother/STemDist","repo_kind":"found_in_text","path":"TimeDC/layers/stdistillation_backbone.py","file_url":"https://github.com/kbrother/STemDist/blob/HEAD/TimeDC/layers/stdistillation_backbone.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e3e8f800d1b05bf7"}},{"code_sha256_prefix":"acfccfb1bee2b921","entry":"TSTEncoderLayer","repo":"kbrother/STemDist","repo_kind":"found_in_text","path":"TimeDC/layers/stdistillation_backbone.py","file_url":"https://github.com/kbrother/STemDist/blob/HEAD/TimeDC/layers/stdistillation_backbone.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"acfccfb1bee2b921"}},{"code_sha256_prefix":"13796d0f4324b8a4","entry":"TSTiEncoder","repo":"kbrother/STemDist","repo_kind":"found_in_text","path":"TimeDC/layers/stdistillation_backbone.py","file_url":"https://github.com/kbrother/STemDist/blob/HEAD/TimeDC/layers/stdistillation_backbone.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"13796d0f4324b8a4"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}