Papers › Holistic Transformer: A Joint Neural Network for Trajectory Prediction and...
Holistic Transformer: A Joint Neural Network for Trajectory Prediction and Decision-Making of Autonomous Vehicles
Hongyu Hu, Qi Wang, Zhengguang Zhang, Zhengyi Li, Zhenhai Gao
Trajectory prediction and behavioral decision-making are two important tasks for autonomous vehicles that require good understanding of the environmental context; behavioral decisions are better made by referring to the outputs of trajectory predictions. However, most current solutions perform these two tasks separately. Therefore, a joint neural network that combines multiple cues is proposed and named as the holistic transformer to predict trajectories and make behavioral decisions simultaneously. To better explore the intrinsic relationships between cues, the network uses existing knowledge and adopts three kinds of attention mechanisms: the sparse multi-head type for reducing noise impact, feature selection sparse type for optimally using partial prior knowledge, and multi-head with sigmoid activation type for optimally using posteriori knowledge. Compared with other trajectory prediction models, the proposed model has better comprehensive performance and good interpretability. Perceptual noise robustness experiments demonstrate that the proposed model has good noise robustness. Thus, simultaneous trajectory prediction and behavioral decision-making combining multiple cues can reduce computational costs and enhance semantic relationships between scenes and agents.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | DAC (K=6) | 0.9865 | #47 of 299 | Archive leaderboard | report |
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | MR (K=1) | 0.5496 | #47 of 299 | Archive leaderboard | report |
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | MR (K=6) | 0.1303 | #47 of 299 | Archive leaderboard | report |
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | brier-minFDE (K=6) | 1.9172 | #47 of 299 | Archive leaderboard | report |
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | minADE (K=1) | 1.5692 | #47 of 299 | Archive leaderboard | report |
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | minADE (K=6) | 0.8123 | #47 of 299 | Archive leaderboard | report |
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | minFDE (K=1) | 3.4284 | #47 of 299 | Archive leaderboard | report |
| Motion Forecasting | Argoverse CVPR 2020 | Holistic Transformer | minFDE (K=6) | 1.2227 | #47 of 299 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections