{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2510-22655","title":"Learning Without Augmenting: Unsupervised Time Series Representation Learning via Frame Projections","arxiv_id":"2510.22655","date":"2025-10-26","proceeding":"NeurIPS","authors":["Berken Utku Demirel","Christian Holz"],"abstract":"Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data. Most SSL approaches rely on strong, well-established, handcrafted data augmentations to generate diverse views for representation learning. However, designing such augmentations requires domain-specific knowledge and implicitly imposes representational invariances on the model, which can limit generalization. In this work, we propose an unsupervised representation learning method that replaces augmentations by generating views using orthonormal bases and overcomplete frames. We show that embeddings learned from orthonormal and overcomplete spaces reside on distinct manifolds, shaped by the geometric biases introduced by representing samples in different spaces. By jointly leveraging the complementary geometry of these distinct manifolds, our approach achieves superior performance without artificially increasing data diversity through strong augmentations. We demonstrate the effectiveness of our method on nine datasets across five temporal sequence tasks, where signal-specific characteristics make data augmentations particularly challenging. Without relying on augmentation-induced diversity, our method achieves performance gains of up to 15--20\\% over existing self-supervised approaches. Source code: https://github.com/eth-siplab/Learning-with-FrameProjections","url_abs":"https://arxiv.org/abs/2510.22655","url_pdf":"https://arxiv.org/pdf/2510.22655","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2510.22655","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2510.22655"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/eth-siplab/Learning-with-FrameProjections","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mims-harvard/TFC-pretraining","reach":{"status":"ok","spdx":"MIT"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/thuml/SimMTM","reach":{"status":"ok"}}],"summary":{"ran":7,"ran_draft_wrong":2,"ran_fixture":1,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":13,"ran":10,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":12,"samples":[{"code_sha256_prefix":"e8144f487350eaa6","entry":"AggregationRebuild","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e8144f487350eaa6"}},{"code_sha256_prefix":"f75b47dd023699cf","entry":"AutomaticWeightedLoss","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f75b47dd023699cf"}},{"code_sha256_prefix":"71ea64a6c323be8c","entry":"ContrastiveWeight","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"71ea64a6c323be8c"}},{"code_sha256_prefix":"10debedf1df80c51","entry":"DSAttention","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"10debedf1df80c51"}},{"code_sha256_prefix":"13e6a08aa0002a5f","entry":"DataEmbedding","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"13e6a08aa0002a5f"}},{"code_sha256_prefix":"46ee27553f379523","entry":"Flatten_Head","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"46ee27553f379523"}},{"code_sha256_prefix":"6b1d91c4a17e3109","entry":"Pooler_Head","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6b1d91c4a17e3109"}},{"code_sha256_prefix":"052e5d686a4b8a50","entry":"mixing_coefficient_set_for_each","repo":"eth-siplab/Learning-with-FrameProjections","repo_kind":"found_in_text","path":"new_augmentations.py","file_url":"https://github.com/eth-siplab/Learning-with-FrameProjections/blob/HEAD/new_augmentations.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"052e5d686a4b8a50"}},{"code_sha256_prefix":"56f374d213d396b0","entry":"mixing_coefficient_set_for_each_phase","repo":"eth-siplab/Learning-with-FrameProjections","repo_kind":"found_in_text","path":"new_augmentations.py","file_url":"https://github.com/eth-siplab/Learning-with-FrameProjections/blob/HEAD/new_augmentations.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"56f374d213d396b0"}},{"code_sha256_prefix":"3697dbd666eb6e8d","entry":"phase_mix","repo":"eth-siplab/Learning-with-FrameProjections","repo_kind":"found_in_text","path":"new_augmentations.py","file_url":"https://github.com/eth-siplab/Learning-with-FrameProjections/blob/HEAD/new_augmentations.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3697dbd666eb6e8d"}},{"code_sha256_prefix":"90a7b7e7a8cf2046","entry":"Model","repo":"thuml/SimMTM","repo_kind":"found_in_text","path":"SimMTM_Forecasting/models/SimMTM.py","file_url":"https://github.com/thuml/SimMTM/blob/HEAD/SimMTM_Forecasting/models/SimMTM.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"90a7b7e7a8cf2046"}},{"code_sha256_prefix":"974a8ce59ee3ad72","entry":"TFC","repo":"mims-harvard/TFC-pretraining","repo_kind":"found_in_text","path":"code/TFC/model.py","file_url":"https://github.com/mims-harvard/TFC-pretraining/blob/HEAD/code/TFC/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"974a8ce59ee3ad72"}},{"code_sha256_prefix":"0d4e0e8b515c0a1d","entry":"gen_new_aug_2","repo":"eth-siplab/Learning-with-FrameProjections","repo_kind":"found_in_text","path":"new_augmentations.py","file_url":"https://github.com/eth-siplab/Learning-with-FrameProjections/blob/HEAD/new_augmentations.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d4e0e8b515c0a1d"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_api"},"syntology_extracted_results":null}