</> Code with Papers by Syntology

Papers › Long-term series forecasting with Query Selector -- efficient model of sparse attention

Long-term series forecasting with Query Selector -- efficient model of sparse attention

19 Jul 2021arXiv:2107.08687archive 2025-07-28

Jacek Klimek, Jakub Klimek, Witold Kraskiewicz, Mateusz Topolewski

Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art results on ETT, Helpdesk and BPI'12 datasets.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

moraieu/query-selector officialmentioned in papermentioned on GitHubpytorch report
moraieu/query-selector-classification mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Multivariate Time Series ForecastingTime SeriesTime Series AnalysisTime Series Forecasting

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multivariate Time Series Forecasting BPI challenge '12 QuerySelector Accuracy 0.79 #1 of 2 Archive leaderboard report
Multivariate Time Series Forecasting Helpdesk QuerySelector Accuracy 0.743 #1 of 2 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Multivariate QuerySelector MAE 0.6088 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Multivariate QuerySelector MSE 0.6835 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Multivariate Transformer MAE 0.6325 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Multivariate Transformer MSE 0.7146 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Univariate QuerySelector MAE 0.2371 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Univariate QuerySelector MSE 0.0935 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Univariate Transformer MAE 0.2539 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (168) Univariate Transformer MSE 0.1049 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Multivariate QuerySelector MAE 0.4627 #3 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Multivariate QuerySelector MSE 0.4226 #3 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Multivariate Transformer MAE 0.4788 #4 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Multivariate Transformer MSE 0.4496 #4 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Univariate QuerySelector MAE 0.1616 #2 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Univariate QuerySelector MSE 0.0436 #2 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Univariate Transformer MAE 0.183 #4 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (24) Univariate Transformer MSE 0.0548 #4 of 5 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Multivariate Transformer MAE 0.7041 #67 of 72 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Multivariate Transformer MSE 0.8321 #67 of 72 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Multivariate QuerySelector MAE 0.7039 #68 of 72 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Multivariate QuerySelector MSE 0.8503 #68 of 72 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Univariate QuerySelector MAE 0.2844 #8 of 10 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Univariate QuerySelector MSE 0.1267 #8 of 10 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Univariate Transformer MAE 0.3201 #9 of 10 Archive leaderboard report
Time Series Forecasting ETTh1 (336) Univariate Transformer MSE 0.1541 #9 of 10 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Multivariate QuerySelector MAE 0.4878 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Multivariate QuerySelector MSE 0.4581 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Multivariate Transformer MAE 0.4968 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Multivariate Transformer MSE 0.4668 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Univariate QuerySelector MAE 0.2118 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Univariate QuerySelector MSE 0.0721 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Univariate Transformer MAE 0.2144 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (48) Univariate Transformer MSE 0.074 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Multivariate Transformer MAE 0.8399 #21 of 22 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Multivariate Transformer MSE 1.108 #21 of 22 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Multivariate QuerySelector MAE 0.8428 #22 of 22 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Multivariate QuerySelector MSE 1.115 #22 of 22 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Univariate QuerySelector MAE 0.373 #11 of 12 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Univariate QuerySelector MSE 0.2136 #11 of 12 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Univariate Transformer MAE 0.4213 #12 of 12 Archive leaderboard report
Time Series Forecasting ETTh1 (720) Univariate Transformer MSE 0.2501 #12 of 12 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Multivariate Transformer MAE 0.9726 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Multivariate Transformer MSE 1.6225 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Multivariate QuerySelector MAE 1.0125 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Multivariate QuerySelector MSE 1.7385 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Univariate QuerySelector MAE 0.3322 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Univariate QuerySelector MSE 0.1753 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Univariate Transformer MAE 0.3547 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (168) Univariate Transformer MSE 0.1974 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Multivariate QuerySelector MAE 0.4864 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Multivariate QuerySelector MSE 0.4124 #2 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Multivariate Transformer MAE 0.5013 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Multivariate Transformer MSE 0.4237 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Univariate QuerySelector MAE 0.2239 #3 of 5 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Univariate QuerySelector MSE 0.0843 #3 of 5 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Univariate Transformer MAE 0.2479 #4 of 5 Archive leaderboard report
Time Series Forecasting ETTh2 (24) Univariate Transformer MSE 0.0999 #4 of 5 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Multivariate QuerySelector MAE 1.1859 #19 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Multivariate QuerySelector MSE 2.3168 #19 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Multivariate Transformer MAE 1.2189 #20 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Multivariate Transformer MSE 2.6617 #20 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Univariate QuerySelector MAE 0.371 #8 of 10 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Univariate QuerySelector MSE 0.2088 #8 of 10 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Univariate Transformer MAE 0.3805 #10 of 10 Archive leaderboard report
Time Series Forecasting ETTh2 (336) Univariate Transformer MSE 0.2191 #10 of 10 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Multivariate QuerySelector MAE 0.9317 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Multivariate QuerySelector MSE 1.4074 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Multivariate Transformer MAE 0.9488 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Multivariate Transformer MSE 1.522 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Univariate QuerySelector MAE 0.2622 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Univariate QuerySelector MSE 0.1117 #3 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Univariate Transformer MAE 0.2763 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (48) Univariate Transformer MSE 0.1218 #4 of 4 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Multivariate QuerySelector MAE 1.3084 #19 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Multivariate QuerySelector MSE 3.0664 #19 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Multivariate Transformer MAE 1.3668 #20 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Multivariate Transformer MSE 3.1805 #20 of 20 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Univariate QuerySelector MAE 0.413 #8 of 11 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Univariate QuerySelector MSE 0.2585 #8 of 11 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Univariate Transformer MAE 0.434 #10 of 11 Archive leaderboard report
Time Series Forecasting ETTh2 (720) Univariate Transformer MSE 0.2853 #10 of 11 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections