Papers › MANTRA: Memory Augmented Networks for Multiple Trajectory Prediction
MANTRA: Memory Augmented Networks for Multiple Trajectory Prediction
Francesco Marchetti, Federico Becattini, Lorenzo Seidenari, Alberto del Bimbo
Autonomous vehicles are expected to drive in complex scenarios with several independent non cooperating agents. Path planning for safely navigating in such environments can not just rely on perceiving present location and motion of other agents. It requires instead to predict such variables in a far enough future. In this paper we address the problem of multimodal trajectory prediction exploiting a Memory Augmented Neural Network. Our method learns past and future trajectory embeddings using recurrent neural networks and exploits an associative external memory to store and retrieve such embeddings. Trajectory prediction is then performed by decoding in-memory future encodings conditioned with the observed past. We incorporate scene knowledge in the decoding state by learning a CNN on top of semantic scene maps. Memory growth is limited by learning a writing controller based on the predictive capability of existing embeddings. We show that our method is able to natively perform multi-modal trajectory prediction obtaining state-of-the art results on three datasets. Moreover, thanks to the non-parametric nature of the memory module, we show how once trained our system can continuously improve by ingesting novel patterns.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Datasets
Introduced by this paper, per the archive.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Trajectory Prediction | ETH/UCY | MANTRA | ADE-8/12 | 0.32 | #13 of 20 | Archive leaderboard | report |
| Trajectory Prediction | ETH/UCY | MANTRA | FDE-8/12 | 0.33 | #13 of 20 | Archive leaderboard | report |
| Trajectory Prediction | Stanford Drone | MANTRA | ADE (8/12) @K=5 | 13.51 | #8 of 24 | Archive leaderboard | report |
| Trajectory Prediction | Stanford Drone | MANTRA | ADE-8/12 @K = 20 | 8.96 | #8 of 24 | Archive leaderboard | report |
| Trajectory Prediction | Stanford Drone | MANTRA | FDE(8/12) @K=5 | 27.34 | #8 of 24 | Archive leaderboard | report |
| Trajectory Prediction | Stanford Drone | MANTRA | FDE-8/12 @K= 20 | 17.76 | #8 of 24 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections