Papers › SimAug: Learning Robust Representations from Simulation for Trajectory Prediction

SimAug: Learning Robust Representations from Simulation for Trajectory Prediction

1 Aug 2020ECCV 2020 8archive 2025-07-28

Junwei Liang, Lu Jiang, Alexander Hauptmann

This paper studies the problem of predicting future trajectories of people in unseen cameras of novel scenarios and views. We approach this problem through the real-data-free setting in which the model is trained only on 3D simulation data and applied out-of-the-box to a wide variety of real cameras. We propose a novel approach to learn robust representation through augmenting the simulation training data such that the representation can better generalize to unseen real-world test data. The key idea is to mix the feature of the hardest camera view with the adversarial feature of the original view. We refer to our method as extitSimAug. We show that extitSimAug achieves promising results on three real-world benchmarks using zero real training data, and state-of-the-art performance in the Stanford Drone and the VIRAT/ActEV dataset when using in-domain training data. Code and models are released at https://next.cs.cmu.edu/simaug

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Adversarial AttackAdversarial DefensePedestrian Trajectory PredictionTrajectory ForecastingTrajectory Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Trajectory Forecasting ActEV SimAug ADE-8/12 17.96 #1 of 2 Archive leaderboard report
Trajectory Forecasting Stanford Drone SimAug ADE-8/12 @K = 20 10.27 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

SimAug

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections