{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tsrating-rating-quality-of-diverse-time","title":"TSRating: Rating Quality of Diverse Time Series Data by Meta-learning from LLM Judgment","arxiv_id":"2506.01290","date":"2025-06-02","proceeding":null,"authors":["Shunyu Wu","Dan Li","Haozheng Ye","Zhuomin Chen","Jiahui Zhou","Jian Lou","Zibin Zheng","See-Kiong Ng"],"abstract":"High-quality time series (TS) data are essential for ensuring TS model performance, rendering research on rating TS data quality indispensable. Existing methods have shown promising rating accuracy within individual domains, primarily by extending data quality rating techniques such as influence functions and Shapley values to account for temporal characteristics. However, they neglect the fact that real-world TS data can span vastly different domains and exhibit distinct properties, hampering the accurate and efficient rating of diverse TS data. In this paper, we propose TSRating, a novel and unified framework for rating the quality of time series data crawled from diverse domains. TSRating is built on the assumption that LLMs inherit ample knowledge, acquired during their extensive pretraining, enabling them to comprehend and discern quality differences in diverse TS data. We verify this assumption by devising a series of prompts to elicit quality comparisons from LLMs for pairs of TS samples. We then fit a dedicated rating model, termed TSRater, to convert the LLMs' judgments into efficient quality predictions via TSRater's inference on future TS samples. To ensure cross-domain adaptability, we develop a meta-learning scheme to train TSRater on quality comparisons collected from nine distinct domains. To improve training efficiency, we employ signSGD for inner-loop updates, thus circumventing the demanding computation of hypergradients. Extensive experimental results on eleven benchmark datasets across three time series tasks, each using both conventional TS models and TS foundation models, demonstrate that TSRating outperforms baselines in terms of estimation accuracy, efficiency, and domain adaptability.","url_abs":"https://arxiv.org/abs/2506.01290v1","url_pdf":"https://arxiv.org/pdf/2506.01290v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"meta-learning","task_name":"Meta-Learning"},{"task_slug":"time-series-1","task_name":"Time Series"}],"methods":[{"method_slug":"ts","method_name":"TS"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2506.01290","atlas_url":"https://app.syntology.ai/?focus=2506.01290","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2506.01290"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/clsr1008/TSRating","reach":null}],"summary":{"ran":3},"by_repo_kind":{"found_in_text":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ba12e211dab59459","entry":"BradleyTerryLoss","repo":"clsr1008/TSRating","repo_kind":"found_in_text","path":"meta_rater/maml.py","file_url":"https://github.com/clsr1008/TSRating/blob/HEAD/meta_rater/maml.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ba12e211dab59459"}},{"code_sha256_prefix":"531f69a5ecb8e3a7","entry":"MetaLearner","repo":"clsr1008/TSRating","repo_kind":"found_in_text","path":"meta_rater/maml.py","file_url":"https://github.com/clsr1008/TSRating/blob/HEAD/meta_rater/maml.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"531f69a5ecb8e3a7"}},{"code_sha256_prefix":"cd8e05048e1b5f19","entry":"ScoreModel","repo":"clsr1008/TSRating","repo_kind":"found_in_text","path":"meta_rater/maml.py","file_url":"https://github.com/clsr1008/TSRating/blob/HEAD/meta_rater/maml.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cd8e05048e1b5f19"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}