{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/units-building-a-unified-time-series-model","title":"UniTS: A Unified Multi-Task Time Series Model","arxiv_id":"2403.00131","date":"2024-02-29","proceeding":null,"authors":["ShangHua Gao","Teddy Koker","Owen Queen","Thomas Hartvigsen","Theodoros Tsiligkaridis","Marinka Zitnik"],"abstract":"Although pre-trained transformers and reprogrammed text-based LLMs have shown strong performance on time series tasks, the best-performing architectures vary widely across tasks, with most models narrowly focused on specific areas, such as time series forecasting. Unifying predictive and generative time series tasks within a single model remains challenging. We introduce UniTS, a unified multi-task time series model that utilizes task tokenization to integrate predictive and generative tasks into a single framework. UniTS employs a modified transformer block to capture universal time series representations, enabling transferability from a heterogeneous, multi-domain pre-training dataset-characterized by diverse dynamic patterns, sampling rates, and temporal scales-to a wide range of downstream datasets with varied task specifications and data domains. Tested on 38 datasets across human activity sensors, healthcare, engineering, and finance, UniTS achieves superior performance compared to 12 forecasting models, 20 classification models, 18 anomaly detection models, and 16 imputation models, including adapted text-based LLMs. UniTS also demonstrates strong few-shot and prompt capabilities when applied to new domains and tasks. In single-task settings, UniTS outperforms competitive task-specialized time series models. Code and datasets are available at https://github.com/mims-harvard/UniTS.","url_abs":"https://arxiv.org/abs/2403.00131v3","url_pdf":"https://arxiv.org/pdf/2403.00131v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"units-building-a-unified-time-series-model","repo_url":"https://github.com/mims-harvard/UniTS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"imputation","task_name":"Imputation"},{"task_slug":"time-series-1","task_name":"Time Series"},{"task_slug":"time-series-forecasting","task_name":"Time Series Forecasting"},{"task_slug":"model","task_name":"model"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/time-series-forecasting-on-etth1-336-1","task":"Time Series Forecasting","dataset":"ETTh1 (336) Multivariate","model":"UniTS-ST","rank_in_archive_order":9,"of":72,"metrics":{"MAE":"0.422","MSE":"0.405"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2403.00131","atlas_url":"https://app.syntology.ai/?focus=2403.00131","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.00131"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/thuml/Time-Series-Library","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/mims-harvard/UniTS","reach":null}],"summary":{"ran":19,"unverified":9},"by_repo_kind":{"official":{"samples":16,"ran":9,"repositories":1},"found_in_text":{"samples":12,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ef2961b050617953","entry":"CrossAttention","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef2961b050617953"}},{"code_sha256_prefix":"2ab8882fbb385d83","entry":"DFT_series_decomp","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ab8882fbb385d83"}},{"code_sha256_prefix":"6a02f6d3ac9d4ea7","entry":"DataEmbedding_wo_pos","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6a02f6d3ac9d4ea7"}},{"code_sha256_prefix":"d81cf82caf0a3c14","entry":"DynamicLinear","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d81cf82caf0a3c14"}},{"code_sha256_prefix":"921d4aae41f22f16","entry":"FixedEmbedding","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"921d4aae41f22f16"}},{"code_sha256_prefix":"18d0036b2989c343","entry":"GateLayer","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"18d0036b2989c343"}},{"code_sha256_prefix":"a7720e5f169c2b3d","entry":"LearnablePositionalEmbedding","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a7720e5f169c2b3d"}},{"code_sha256_prefix":"125e0c04535acce1","entry":"MultiScaleSeasonMixing","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"125e0c04535acce1"}},{"code_sha256_prefix":"d85e5a2fd0a672ba","entry":"Normalize","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d85e5a2fd0a672ba"}},{"code_sha256_prefix":"4a082cb4e49aff69","entry":"PastDecomposableMixing","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4a082cb4e49aff69"}},{"code_sha256_prefix":"acc8fc941a65797e","entry":"PatchEmbedding","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"acc8fc941a65797e"}},{"code_sha256_prefix":"5da1d16a64cf53ce","entry":"PositionalEmbedding","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5da1d16a64cf53ce"}},{"code_sha256_prefix":"dda0e56e79965b1b","entry":"SeqAttBlock","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dda0e56e79965b1b"}},{"code_sha256_prefix":"454a1cd3d3329ede","entry":"SeqAttention","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"454a1cd3d3329ede"}},{"code_sha256_prefix":"f42ba6fda711db0d","entry":"TemporalEmbedding","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f42ba6fda711db0d"}},{"code_sha256_prefix":"98a0817e251d19c7","entry":"TimeFeatureEmbedding","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"98a0817e251d19c7"}},{"code_sha256_prefix":"588a4a8475ed63a0","entry":"TokenEmbedding","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"588a4a8475ed63a0"}},{"code_sha256_prefix":"35326016e90c28ac","entry":"VarAttBlock","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"35326016e90c28ac"}},{"code_sha256_prefix":"03d429ddb106034b","entry":"VarAttention","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"03d429ddb106034b"}},{"code_sha256_prefix":"d3cc5ae17d330bdd","entry":"BasicBlock","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3cc5ae17d330bdd"}},{"code_sha256_prefix":"d1b2155e7ac7b6df","entry":"CLSHead","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d1b2155e7ac7b6df"}},{"code_sha256_prefix":"be28d50c76414fa6","entry":"DynamicLinearMlp","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be28d50c76414fa6"}},{"code_sha256_prefix":"bfe2418bb89918c9","entry":"ForecastHead","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bfe2418bb89918c9"}},{"code_sha256_prefix":"9707fb7077958a62","entry":"MLPBlock","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9707fb7077958a62"}},{"code_sha256_prefix":"b1d72a6f113503e9","entry":"Model","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1d72a6f113503e9"}},{"code_sha256_prefix":"1a32039eae4bf633","entry":"Model","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1a32039eae4bf633"}},{"code_sha256_prefix":"ad047f96a9f8d71f","entry":"MultiScaleTrendMixing","repo":"thuml/Time-Series-Library","repo_kind":"found_in_text","path":"models/TimeMixer.py","file_url":"https://github.com/thuml/Time-Series-Library/blob/HEAD/models/TimeMixer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ad047f96a9f8d71f"}},{"code_sha256_prefix":"ea42266bafc13587","entry":"calculate_unfold_output_length","repo":"mims-harvard/UniTS","repo_kind":"official","path":"models/UniTS.py","file_url":"https://github.com/mims-harvard/UniTS/blob/HEAD/models/UniTS.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea42266bafc13587"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}