Papers › HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction

HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction

1 Jan 2022CVPR 2022 1archive 2025-07-28

Zikang Zhou, Luyao Ye, JianPing Wang, Kui Wu, Kejie Lu

Accurately predicting the future motions of surrounding traffic agents is critical for the safety of autonomous vehicles. Recently, vectorized approaches have dominated the motion prediction community due to their capability of capturing complex interactions in traffic scenes. However, existing methods neglect the symmetries of the problem and suffer from the expensive computational cost, facing the challenge of making real-time multi-agent motion prediction without sacrificing the prediction performance. To tackle this challenge, we propose Hierarchical Vector Transformer (HiVT) for fast and accurate multi-agent motion prediction. By decomposing the problem into local context extraction and global interaction modeling, our method can effectively and efficiently model a large number of agents in the scene. Meanwhile, we propose a translation-invariant scene representation and rotation-invariant spatial learning modules, which extract features robust to the geometric transformations of the scene and enable the model to make accurate predictions for multiple agents in a single forward pass. Experiments show that HiVT achieves the state-of-the-art performance on the Argoverse motion forecasting benchmark with a small model size and can make fast multi-agent motion prediction.

PaperPDFCode

Code

ZikangZhou/HiVT officialpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Autonomous DrivingAutonomous VehiclesMotion ForecastingPredictionSelf-Driving CarsTrajectory Predictionmotion prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Motion Forecasting Argoverse CVPR 2020 HiVT++ DAC (K=6) 0.9891 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT++ MR (K=1) 0.5431 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT++ MR (K=6) 0.1221 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT++ brier-minFDE (K=6) 1.8171 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT++ minADE (K=1) 1.5619 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT++ minADE (K=6) 0.7673 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT++ minFDE (K=1) 3.4449 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT++ minFDE (K=6) 1.146 #24 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 DAC (K=6) 0.9888 #28 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 MR (K=1) 0.5473 #28 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 MR (K=6) 0.1267 #28 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 brier-minFDE (K=6) 1.8422 #28 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 minADE (K=1) 1.5984 #28 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 minADE (K=6) 0.7735 #28 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 minFDE (K=1) 3.5328 #28 of 299 Archive leaderboard report
Motion Forecasting Argoverse CVPR 2020 HiVT-128 minFDE (K=6) 1.1693 #28 of 299 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AttentionDropoutLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections