{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/test-text-prototype-aligned-embedding-to","title":"TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Series","arxiv_id":"2308.08241","date":"2023-08-16","proceeding":null,"authors":["Chenxi Sun","Hongyan Li","Yaliang Li","Shenda Hong"],"abstract":"This work summarizes two ways to accomplish Time-Series (TS) tasks in today's Large Language Model (LLM) context: LLM-for-TS (model-centric) designs and trains a fundamental large model, or fine-tunes a pre-trained LLM for TS data; TS-for-LLM (data-centric) converts TS into a model-friendly representation to enable the pre-trained LLM to handle TS data. Given the lack of data, limited resources, semantic context requirements, and so on, this work focuses on TS-for-LLM, where we aim to activate LLM's ability for TS data by designing a TS embedding method suitable for LLM. The proposed method is named TEST. It first tokenizes TS, builds an encoder to embed TS via instance-wise, feature-wise, and text-prototype-aligned contrast, where the TS embedding space is aligned to LLM embedding layer space, then creates soft prompts to make LLM more open to that embeddings, and finally implements TS tasks using the frozen LLM. We also demonstrate the feasibility of TS-for-LLM through theory and experiments. Experiments are carried out on TS classification, forecasting, and representation tasks using eight frozen LLMs with various structures and sizes. The results show that the pre-trained LLM with TEST strategy can achieve better or comparable performance than today's SOTA TS models and offer benefits for few-shot and generalization. By treating LLM as the pattern machine, TEST can endow LLM's ability to process TS data without compromising language ability. We hope that this study will serve as a foundation for future work to support TS+LLM progress.","url_abs":"https://arxiv.org/abs/2308.08241v2","url_pdf":"https://arxiv.org/pdf/2308.08241v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"test-text-prototype-aligned-embedding-to","repo_url":"https://github.com/scxsunchenxi/test","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"large-language-model","task_name":"Large Language Model"},{"task_slug":"time-series-1","task_name":"Time Series"}],"methods":[{"method_slug":"ts","method_name":"TS"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.08241","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.08241"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/scxsunchenxi/test","reach":{"status":"ok"}}],"summary":{"ran":7,"unverified":4},"by_repo_kind":{"official":{"samples":11,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":11,"samples":[{"code_sha256_prefix":"03d63d172032b256","entry":"CORR","repo":"scxsunchenxi/test","repo_kind":"official","path":"losses/metrics.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/losses/metrics.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"03d63d172032b256"}},{"code_sha256_prefix":"5346622dac785f32","entry":"get_loss_module","repo":"scxsunchenxi/test","repo_kind":"official","path":"models/loss.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/models/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5346622dac785f32"}},{"code_sha256_prefix":"c43495731acfe20c","entry":"interpolate_missing","repo":"scxsunchenxi/test","repo_kind":"official","path":"datasets_classification/data.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/datasets_classification/data.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c43495731acfe20c"}},{"code_sha256_prefix":"96c6fa7dd49845b2","entry":"l2_reg_loss","repo":"scxsunchenxi/test","repo_kind":"official","path":"models/loss.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/models/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"96c6fa7dd49845b2"}},{"code_sha256_prefix":"5e6baee53c4a2249","entry":"select_prototype","repo":"scxsunchenxi/test","repo_kind":"official","path":"losses/text_prototype.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/losses/text_prototype.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e6baee53c4a2249"}},{"code_sha256_prefix":"c1b94131b3d433b1","entry":"select_representative","repo":"scxsunchenxi/test","repo_kind":"official","path":"losses/text_prototype.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/losses/text_prototype.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c1b94131b3d433b1"}},{"code_sha256_prefix":"99cb2d7796fc399b","entry":"subsample","repo":"scxsunchenxi/test","repo_kind":"official","path":"datasets_classification/data.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/datasets_classification/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"99cb2d7796fc399b"}},{"code_sha256_prefix":"75f44993b096bf76","entry":"MAE","repo":"scxsunchenxi/test","repo_kind":"official","path":"losses/metrics.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/losses/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"75f44993b096bf76"}},{"code_sha256_prefix":"b40a11875ebd0cd2","entry":"RSE","repo":"scxsunchenxi/test","repo_kind":"official","path":"losses/metrics.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/losses/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b40a11875ebd0cd2"}},{"code_sha256_prefix":"f79cf1a40c083fee","entry":"convert_metrics_per_batch_to_per_sample","repo":"scxsunchenxi/test","repo_kind":"official","path":"running.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/running.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f79cf1a40c083fee"}},{"code_sha256_prefix":"b8f656bc0425d825","entry":"get_optimizer","repo":"scxsunchenxi/test","repo_kind":"official","path":"optimizers.py","file_url":"https://github.com/scxsunchenxi/test/blob/HEAD/optimizers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b8f656bc0425d825"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}