{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/vitime-a-visual-intelligence-based-foundation","title":"ViTime: A Visual Intelligence-Based Foundation Model for Time Series Forecasting","arxiv_id":"2407.07311","date":"2024-07-10","proceeding":null,"authors":["Luoxiao Yang","Yun Wang","Xinqi Fan","Israel Cohen","Jingdong Chen","Yue Zhao","Zijun Zhang"],"abstract":"The success of large pretrained models in natural language processing (NLP) and computer vision (CV) has opened new avenues for constructing foundation models for time series forecasting (TSF). Traditional TSF foundation models rely heavily on numerical data fitting. In contrast, the human brain is inherently skilled at processing visual information, prefer predicting future trends by observing visualized sequences. From a biomimetic perspective, utilizing models to directly process numerical sequences might not be the most effective route to achieving Artificial General Intelligence (AGI). This paper proposes ViTime, a novel Visual Intelligence-based foundation model for TSF. ViTime overcomes the limitations of numerical time series data fitting by utilizing visual data processing paradigms and employs a innovative data synthesis method during training, called Real Time Series (RealTS). Experiments on a diverse set of previously unseen forecasting datasets demonstrate that ViTime achieves state-of-the-art zero-shot performance, even surpassing the best individually trained supervised models in some situations. These findings suggest that visual intelligence can significantly enhance time series analysis and forecasting, paving the way for more advanced and versatile models in the field. The code for our framework is accessible at https://github.com/IkeYang/ViTime.","url_abs":"https://arxiv.org/abs/2407.07311v2","url_pdf":"https://arxiv.org/pdf/2407.07311v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"vitime-a-visual-intelligence-based-foundation","repo_url":"https://github.com/ikeyang/vitime","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"time-series-1","task_name":"Time Series"},{"task_slug":"time-series","task_name":"Time Series Analysis"},{"task_slug":"time-series-forecasting","task_name":"Time Series Forecasting"}],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2407.07311","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.07311"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ikeyang/vitime","reach":{"status":"ok"}}],"summary":{"ran":6,"ran_fixture":1,"unverified":2},"by_repo_kind":{"official":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"e59ffdb9614460c4","entry":"conv_1x1_bn","repo":"ikeyang/vitime","repo_kind":"official","path":"model/mobilenetv2.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/model/mobilenetv2.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e59ffdb9614460c4"}},{"code_sha256_prefix":"3cd17ddf57999b0a","entry":"conv_bn","repo":"ikeyang/vitime","repo_kind":"official","path":"model/mobilenetv2.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/model/mobilenetv2.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3cd17ddf57999b0a"}},{"code_sha256_prefix":"e5947aba1d10885f","entry":"get_1d_sincos_pos_embed_from_grid","repo":"ikeyang/vitime","repo_kind":"official","path":"model/ViTimeAutoencoder.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/model/ViTimeAutoencoder.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e5947aba1d10885f"}},{"code_sha256_prefix":"6bf22e812fb0381e","entry":"get_2d_sincos_pos_embed","repo":"ikeyang/vitime","repo_kind":"official","path":"model/ViTimeAutoencoder.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/model/ViTimeAutoencoder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6bf22e812fb0381e"}},{"code_sha256_prefix":"3702eb011167eb64","entry":"interX","repo":"ikeyang/vitime","repo_kind":"official","path":"datafactory/loadData.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/datafactory/loadData.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3702eb011167eb64"}},{"code_sha256_prefix":"b5c8e430bdc8e4ef","entry":"load_url","repo":"ikeyang/vitime","repo_kind":"official","path":"model/mobilenetv2.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/model/mobilenetv2.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b5c8e430bdc8e4ef"}},{"code_sha256_prefix":"762d3318d443782a","entry":"resolve_model_path","repo":"ikeyang/vitime","repo_kind":"official","path":"config.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"762d3318d443782a"}},{"code_sha256_prefix":"665d8a4e8f673a4c","entry":"get_2d_sincos_pos_embed_from_grid","repo":"ikeyang/vitime","repo_kind":"official","path":"model/ViTimeAutoencoder.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/model/ViTimeAutoencoder.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"665d8a4e8f673a4c"}},{"code_sha256_prefix":"347e7d8071605542","entry":"xception","repo":"ikeyang/vitime","repo_kind":"official","path":"model/xception.py","file_url":"https://github.com/ikeyang/vitime/blob/HEAD/model/xception.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"347e7d8071605542"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}