{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/timesiam-a-pre-training-framework-for-siamese","title":"TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling","arxiv_id":"2402.02475","date":"2024-02-04","proceeding":null,"authors":["Jiaxiang Dong","Haixu Wu","Yuxuan Wang","Yunzhong Qiu","Li Zhang","Jianmin Wang","Mingsheng Long"],"abstract":"Time series pre-training has recently garnered wide attention for its potential to reduce labeling expenses and benefit various downstream tasks. Prior methods are mainly based on pre-training techniques well-acknowledged in vision or language, such as masked modeling and contrastive learning. However, randomly masking time series or calculating series-wise similarity will distort or neglect inherent temporal correlations crucial in time series data. To emphasize temporal correlation modeling, this paper proposes TimeSiam as a simple but effective self-supervised pre-training framework for Time series based on Siamese networks. Concretely, TimeSiam pre-trains Siamese encoders to capture intrinsic temporal correlations between randomly sampled past and current subseries. With a simple data augmentation method (e.g.~masking), TimeSiam can benefit from diverse augmented subseries and learn internal time-dependent representations through a past-to-current reconstruction. Moreover, learnable lineage embeddings are also introduced to distinguish temporal distance between sampled series and further foster the learning of diverse temporal correlations. TimeSiam consistently outperforms extensive advanced pre-training baselines, demonstrating superior forecasting and classification capabilities across 13 standard benchmarks in both intra- and cross-domain scenarios.","url_abs":"https://arxiv.org/abs/2402.02475v2","url_pdf":"https://arxiv.org/pdf/2402.02475v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"timesiam-a-pre-training-framework-for-siamese","repo_url":"https://github.com/thuml/TimeSiam","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"time-series-1","task_name":"Time Series"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2402.02475","atlas_url":"https://app.syntology.ai/?focus=2402.02475","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.02475"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/thuml/TimeSiam","reach":null}],"summary":{"ran_violates":1,"ran_fixture":1,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1c4d90cb741a3bdf","entry":"geom_noise_mask_single","repo":"thuml/TimeSiam","repo_kind":"official","path":"utils/augmentations.py","file_url":"https://github.com/thuml/TimeSiam/blob/HEAD/utils/augmentations.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c4d90cb741a3bdf"}},{"code_sha256_prefix":"6bca7814927001cc","entry":"masked_data","repo":"thuml/TimeSiam","repo_kind":"official","path":"utils/augmentations.py","file_url":"https://github.com/thuml/TimeSiam/blob/HEAD/utils/augmentations.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6bca7814927001cc"}},{"code_sha256_prefix":"780c2a7d90990abe","entry":"noise_mask","repo":"thuml/TimeSiam","repo_kind":"official","path":"utils/augmentations.py","file_url":"https://github.com/thuml/TimeSiam/blob/HEAD/utils/augmentations.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"780c2a7d90990abe"}},{"code_sha256_prefix":"4c12be356d5d5d7b","entry":"get_model","repo":"thuml/TimeSiam","repo_kind":"official","path":"exp/pretrain.py","file_url":"https://github.com/thuml/TimeSiam/blob/HEAD/exp/pretrain.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c12be356d5d5d7b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}