{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tspp-a-unified-benchmarking-tool-for-time","title":"TSPP: A Unified Benchmarking Tool for Time-series Forecasting","arxiv_id":"2312.17100","date":"2023-12-28","proceeding":null,"authors":["Jan Bączek","Dmytro Zhylko","Gilberto Titericz","Sajad Darabi","Jean-Francois Puget","Izzy Putterman","Dawid Majchrowski","Anmol Gupta","Kyle Kranen","Pawel Morkisz"],"abstract":"While machine learning has witnessed significant advancements, the emphasis has largely been on data acquisition and model creation. However, achieving a comprehensive assessment of machine learning solutions in real-world settings necessitates standardization throughout the entire pipeline. This need is particularly acute in time series forecasting, where diverse settings impede meaningful comparisons between various methods. To bridge this gap, we propose a unified benchmarking framework that exposes the crucial modelling and machine learning decisions involved in developing time series forecasting models. This framework fosters seamless integration of models and datasets, aiding both practitioners and researchers in their development efforts. We benchmark recently proposed models within this framework, demonstrating that carefully implemented deep learning models with minimal effort can rival gradient-boosting decision trees requiring extensive feature engineering and expert knowledge.","url_abs":"https://arxiv.org/abs/2312.17100v2","url_pdf":"https://arxiv.org/pdf/2312.17100v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tspp-a-unified-benchmarking-tool-for-time","repo_url":"https://github.com/NVIDIA/DeepLearningExamples/tree/master/Tools/PyTorch/TimeSeriesPredictionPlatform","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"feature-engineering","task_name":"Feature Engineering"},{"task_slug":"fraud-detection","task_name":"Fraud Detection"},{"task_slug":"graph-generation","task_name":"Graph Generation"},{"task_slug":"graph-learning","task_name":"Graph Learning"},{"task_slug":"recommendation-systems","task_name":"Recommendation Systems"},{"task_slug":"time-series-1","task_name":"Time Series"},{"task_slug":"time-series-forecasting","task_name":"Time Series Forecasting"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}