{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2608-18675","title":"An Empirical Benchmark of Deep Time-Series Models for Smart Meter Energy Forecasting","arxiv_id":"2608.18675","date":"2026-08-19","proceeding":null,"authors":["Behnaz Kavoosighafi","Maria Eidenskog","Wiktoria Glad","Katerina Vrotsou"],"abstract":"Accurate forecasting of energy consumption is important for the efficient operation of power systems, with direct implications for operational costs, energy management, and system maintenance. Due to the availability of extensive high-resolution consumption data from smart meters, data-driven methods have been used for short-term and long-term forecasting. However, their comparative performance on real-world smart meter data is still not well studied. In this paper, we present an empirical benchmark of nine modern deep learning models for time-series forecasting, including linear, MLP-based, convolutional, and Transformer architectures. We evaluate these models on two publicly available smart meter datasets. Our analysis focuses on three factors that strongly affect forecasting performance: the length of historical input, the prediction horizon, and the choice of model architecture. We show that extending the historical context improves accuracy, but only up to a saturation point, after which additional input provides limited benefit. In contrast, accuracy decreases as the prediction horizon increases. We also investigate the trade-off between prediction accuracy and computational complexity, and assess the statistical significance and practical magnitude of performance differences across models. Our results show that deep learning models consistently outperform classical baselines, while lightweight architectures achieve relatively similar performance at significantly lower computational cost. Additionally, architectural differences only become meaningful at longer forecasting horizons and on more heterogeneous datasets. Finally, a subgroup analysis across geodemographic and household categories shows that model choice has limited impact for most population segments.","url_abs":"https://arxiv.org/abs/2608.18675","url_pdf":"https://arxiv.org/pdf/2608.18675","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2608.18675","atlas_url":"https://app.syntology.ai/?focus=2608.18675","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2608.18675"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library","reach":null}],"summary":{"ran":12,"ran_honours":1},"by_repo_kind":{"found_in_text":{"samples":13,"ran":13,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"14b374fc9cf25339","entry":"compute_enc_in","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"benchmark_pecan.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/benchmark_pecan.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"14b374fc9cf25339"}},{"code_sha256_prefix":"a16791e2fc073028","entry":"compute_enc_in","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"benchmark_transformers.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/benchmark_transformers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a16791e2fc073028"}},{"code_sha256_prefix":"489bd6cef8f516f5","entry":"compute_meta_dim","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"benchmark_pecan.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/benchmark_pecan.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"489bd6cef8f516f5"}},{"code_sha256_prefix":"0458118a71d304b9","entry":"compute_meta_dim","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"benchmark_transformers.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/benchmark_transformers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0458118a71d304b9"}},{"code_sha256_prefix":"2af0df7394e58e06","entry":"conv1d_fft","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"layers/ETSformer_EncDec.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/layers/ETSformer_EncDec.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2af0df7394e58e06"}},{"code_sha256_prefix":"592ea8b254b006db","entry":"get_frequency_modes","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"layers/FourierCorrelation.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/layers/FourierCorrelation.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"592ea8b254b006db"}},{"code_sha256_prefix":"2c88fa85214e7d48","entry":"mae","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"compute_metrics.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/compute_metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2c88fa85214e7d48"}},{"code_sha256_prefix":"ef459726ef257947","entry":"mape","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"compute_metrics.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/compute_metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef459726ef257947"}},{"code_sha256_prefix":"2b6fd75c6acd97d9","entry":"mse","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"compute_metrics.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/compute_metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b6fd75c6acd97d9"}},{"code_sha256_prefix":"9b32a3bb18b1cafe","entry":"mypad","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"layers/DWT_Decomposition.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/layers/DWT_Decomposition.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b32a3bb18b1cafe"}},{"code_sha256_prefix":"1f71d273b7f9da7c","entry":"parse_metrics","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"benchmark_pecan.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/benchmark_pecan.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1f71d273b7f9da7c"}},{"code_sha256_prefix":"f849694f3be3c099","entry":"parse_metrics","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"benchmark_transformers.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/benchmark_transformers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f849694f3be3c099"}},{"code_sha256_prefix":"d80521898a085cf9","entry":"roll","repo":"behnazkavoosi/Energy-Time-Series-Library","repo_kind":"found_in_text","path":"layers/DWT_Decomposition.py","file_url":"https://github.com/behnazkavoosi/Energy-Time-Series-Library/blob/HEAD/layers/DWT_Decomposition.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d80521898a085cf9"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,885 of the 9,623 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9623,"papers_checked":6885},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}