{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2510-19980","title":"Abstain Mask Retain Core: Time Series Prediction by Adaptive Masking Loss with Representation Consistency","arxiv_id":"2510.19980","date":"2025-10-22","proceeding":"NeurIPS","authors":["Renzhao Liang","Sizhe Xu","Chenggang Xie","Jingru Chen","Feiyang Ren","Shu Yang","Takahiro Yabe"],"abstract":"Time series forecasting plays a pivotal role in critical domains such as energy management and financial markets. Although deep learning-based approaches (e.g., MLP, RNN, Transformer) have achieved remarkable progress, the prevailing \"long-sequence information gain hypothesis\" exhibits inherent limitations. Through systematic experimentation, this study reveals a counterintuitive phenomenon: appropriately truncating historical data can paradoxically enhance prediction accuracy, indicating that existing models learn substantial redundant features (e.g., noise or irrelevant fluctuations) during training, thereby compromising effective signal extraction. Building upon information bottleneck theory, we propose an innovative solution termed Adaptive Masking Loss with Representation Consistency (AMRC), which features two core components: 1) Dynamic masking loss, which adaptively identified highly discriminative temporal segments to guide gradient descent during model training; 2) Representation consistency constraint, which stabilized the mapping relationships among inputs, labels, and predictions. Experimental results demonstrate that AMRC effectively suppresses redundant feature learning while significantly improving model performance. This work not only challenges conventional assumptions in temporal modeling but also provides novel theoretical insights and methodological breakthroughs for developing efficient and robust forecasting models.","url_abs":"https://arxiv.org/abs/2510.19980","url_pdf":"https://arxiv.org/pdf/2510.19980","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2510.19980","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2510.19980"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Secilia-Cxy/SOFTS","reach":{"status":"ok","spdx":"MIT"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/kwuking/TimeMixer","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/yuqinie98/PatchTST","reach":{"status":"ok","spdx":"Apache-2.0"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/thuml/iTransformer","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/MazelTovy/AMRC","reach":{"status":"ok"}},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/ditschuk/pytorch-tsmixer","reach":null}],"summary":{"ran":3,"ran_honours":1,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":8,"ran":4,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"4f5849281bea173b","entry":"FeatureMixing","repo":"ditschuk/pytorch-tsmixer","repo_kind":"found_in_text","path":"torchtsmixer/layers.py","file_url":"https://github.com/ditschuk/pytorch-tsmixer/blob/HEAD/torchtsmixer/layers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4f5849281bea173b"}},{"code_sha256_prefix":"16b9b78d429636b7","entry":"PositionalEncoding","repo":"MazelTovy/AMRC","repo_kind":"found_in_text","path":"PatchTST/layers/PatchTST_layers.py","file_url":"https://github.com/MazelTovy/AMRC/blob/HEAD/PatchTST/layers/PatchTST_layers.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"16b9b78d429636b7"}},{"code_sha256_prefix":"68fd9c4c0068fea7","entry":"TimeBatchNorm2d","repo":"ditschuk/pytorch-tsmixer","repo_kind":"found_in_text","path":"torchtsmixer/layers.py","file_url":"https://github.com/ditschuk/pytorch-tsmixer/blob/HEAD/torchtsmixer/layers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68fd9c4c0068fea7"}},{"code_sha256_prefix":"72b9272542f279c6","entry":"get_activation_fn","repo":"MazelTovy/AMRC","repo_kind":"found_in_text","path":"PatchTST/layers/PatchTST_layers.py","file_url":"https://github.com/MazelTovy/AMRC/blob/HEAD/PatchTST/layers/PatchTST_layers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"72b9272542f279c6"}},{"code_sha256_prefix":"c3fc6992d1e467f3","entry":"Coord2dPosEncoding","repo":"MazelTovy/AMRC","repo_kind":"found_in_text","path":"PatchTST/layers/PatchTST_layers.py","file_url":"https://github.com/MazelTovy/AMRC/blob/HEAD/PatchTST/layers/PatchTST_layers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c3fc6992d1e467f3"}},{"code_sha256_prefix":"9cd8f6afc19c1e1d","entry":"create_dummy_data","repo":"MazelTovy/AMRC","repo_kind":"found_in_text","path":"TSMixer/train_tsmixer_amrc.py","file_url":"https://github.com/MazelTovy/AMRC/blob/HEAD/TSMixer/train_tsmixer_amrc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9cd8f6afc19c1e1d"}},{"code_sha256_prefix":"9a5fcd4ebfc55d03","entry":"time_features","repo":"Secilia-Cxy/SOFTS","repo_kind":"found_in_text","path":"utils/timefeatures.py","file_url":"https://github.com/Secilia-Cxy/SOFTS/blob/HEAD/utils/timefeatures.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9a5fcd4ebfc55d03"}},{"code_sha256_prefix":"f8544563682146e5","entry":"time_features_from_frequency_str","repo":"Secilia-Cxy/SOFTS","repo_kind":"found_in_text","path":"utils/timefeatures.py","file_url":"https://github.com/Secilia-Cxy/SOFTS/blob/HEAD/utils/timefeatures.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f8544563682146e5"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_api"},"syntology_extracted_results":null}