</> Code with Papers by Syntology

Papers › STAEformer: Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for...

STAEformer: Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for Traffic Forecasting

21 Aug 2023arXiv:2308.10425archive 2025-07-28

Hangchen Liu, Zheng Dong, Renhe Jiang, Jiewen Deng, Jinliang Deng, Quanjun Chen, Xuan Song

With the rapid development of the Intelligent Transportation System (ITS), accurate traffic forecasting has emerged as a critical challenge. The key bottleneck lies in capturing the intricate spatio-temporal traffic patterns. In recent years, numerous neural networks with complicated architectures have been proposed to address this issue. However, the advancements in network architectures have encountered diminishing performance gains. In this study, we present a novel component called spatio-temporal adaptive embedding that can yield outstanding results with vanilla transformers. Our proposed Spatio-Temporal Adaptive Embedding transformer (STAEformer) achieves state-of-the-art performance on five real-world traffic forecasting datasets. Further experiments demonstrate that spatio-temporal adaptive embedding plays a crucial role in traffic forecasting by effectively capturing intrinsic spatio-temporal relations and chronological information in traffic time series.

PaperPDFCode

Code

xdzhelheim/staeformer officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Time SeriesTraffic Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Traffic Prediction METR-LA STAEformer MAE @ 12 step 3.34 #6 of 20 Archive leaderboard report
Traffic Prediction METR-LA STAEformer MAE @ 3 step 2.65 #6 of 20 Archive leaderboard report
Traffic Prediction PEMS-BAY STAEformer MAE @ 12 step 1.91 #11 of 16 Archive leaderboard report
Traffic Prediction PeMS04 STAEformer 12 Steps MAE 18.22 #5 of 12 Archive leaderboard report
Traffic Prediction PeMS07 STAEformer MAE@1h 19.14 #2 of 17 Archive leaderboard report
Traffic Prediction PeMS08 STAEformer MAE@1h 13.46 #5 of 13 Archive leaderboard report
Traffic Prediction PeMSD7 STAEformer 12 steps MAE 19.14 #2 of 8 Archive leaderboard report
Traffic Prediction PeMSD7 STAEformer 12 steps MAPE 8.01 #2 of 8 Archive leaderboard report
Traffic Prediction PeMSD7 STAEformer 12 steps RMSE 32.60 #2 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections