{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/foundation-models-for-spatio-temporal-data","title":"Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey","arxiv_id":"2503.13502","date":"2025-03-12","proceeding":null,"authors":["Yuxuan Liang","Haomin Wen","Yutong Xia","Ming Jin","Bin Yang","Flora Salim","Qingsong Wen","Shirui Pan","Gao Cong"],"abstract":"Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent transportation. Traditional deep learning approaches have significantly advanced this field, particularly in the stage of ST data mining. However, these models remain task-specific and often require extensive labeled data. Inspired by the success of Foundation Models (FM), especially large language models, researchers have begun exploring the concept of Spatio-Temporal Foundation Models (STFMs) to enhance adaptability and generalization across diverse ST tasks. Unlike prior architectures, STFMs empower the entire workflow of ST data science, ranging from data sensing, management, to mining, thereby offering a more holistic and scalable approach. Despite rapid progress, a systematic study of STFMs for ST data science remains lacking. This survey aims to provide a comprehensive review of STFMs, categorizing existing methodologies and identifying key research directions to advance ST general intelligence.","url_abs":"https://arxiv.org/abs/2503.13502v1","url_pdf":"https://arxiv.org/pdf/2503.13502v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"foundation-models-for-spatio-temporal-data","repo_url":"https://github.com/winfredge/t2s","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"management","task_name":"Management"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2503.13502","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.13502"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/winfredge/t2s","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":3,"ran_violates":2,"unverified":9},"by_repo_kind":{"listed":{"samples":14,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"12d73e40361cea46","entry":"acf_torch","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluate/feature_based_measures.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluate/feature_based_measures.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"12d73e40361cea46"}},{"code_sha256_prefix":"b11fd8459d71a086","entry":"determine_device","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluate/utils.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluate/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b11fd8459d71a086"}},{"code_sha256_prefix":"fd10054ec4772b80","entry":"generate_binomial_mask","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluate/ts2vec.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluate/ts2vec.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fd10054ec4772b80"}},{"code_sha256_prefix":"acda587a1d1be3bf","entry":"generate_continuous_mask","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluate/ts2vec.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluate/ts2vec.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"acda587a1d1be3bf"}},{"code_sha256_prefix":"9f3f5233a9f7a99f","entry":"histogram_torch","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluate/feature_based_measures.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluate/feature_based_measures.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9f3f5233a9f7a99f"}},{"code_sha256_prefix":"d82bd93d77a079bf","entry":"any_length_evaluation","repo":"winfredge/t2s","repo_kind":"listed","path":"pretrained_lavae_unified.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/pretrained_lavae_unified.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d82bd93d77a079bf"}},{"code_sha256_prefix":"329507de6aa07e90","entry":"calculate_crps","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluation.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"329507de6aa07e90"}},{"code_sha256_prefix":"289e725b6db86015","entry":"calculate_mdd","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluate/feature_based_measures.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluate/feature_based_measures.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"289e725b6db86015"}},{"code_sha256_prefix":"64cff81f8e0ee1dd","entry":"calculate_mrr","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluation.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"64cff81f8e0ee1dd"}},{"code_sha256_prefix":"76d56d4f0fe92df8","entry":"check_json_format","repo":"winfredge/t2s","repo_kind":"listed","path":"Dataset_Construction_Pipeline/Get_Embedding_and_Convert_JSON_to_CSV.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/Dataset_Construction_Pipeline/Get_Embedding_and_Convert_JSON_to_CSV.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"76d56d4f0fe92df8"}},{"code_sha256_prefix":"967329189b4a8731","entry":"clean_embedding_string","repo":"winfredge/t2s","repo_kind":"listed","path":"Dataset_Construction_Pipeline/Evaluate_Datasets.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/Dataset_Construction_Pipeline/Evaluate_Datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"967329189b4a8731"}},{"code_sha256_prefix":"ae78b69362a23bd8","entry":"cosine_similarity","repo":"winfredge/t2s","repo_kind":"listed","path":"Dataset_Construction_Pipeline/Evaluate_Datasets.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/Dataset_Construction_Pipeline/Evaluate_Datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ae78b69362a23bd8"}},{"code_sha256_prefix":"0ff3801deacfdeec","entry":"custom_collate_fn","repo":"winfredge/t2s","repo_kind":"listed","path":"datafactory/dataloader.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/datafactory/dataloader.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0ff3801deacfdeec"}},{"code_sha256_prefix":"98a90a05f7630bee","entry":"initialize_ts2vec","repo":"winfredge/t2s","repo_kind":"listed","path":"evaluate/ts2vec.py","file_url":"https://github.com/winfredge/t2s/blob/HEAD/evaluate/ts2vec.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"98a90a05f7630bee"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}