Papers › Future Video Synthesis with Object Motion Prediction
Future Video Synthesis with Object Motion Prediction
Yue Wu, Rongrong Gao, Jaesik Park, Qifeng Chen
We present an approach to predict future video frames given a sequence of continuous video frames in the past. Instead of synthesizing images directly, our approach is designed to understand the complex scene dynamics by decoupling the background scene and moving objects. The appearance of the scene components in the future is predicted by non-rigid deformation of the background and affine transformation of moving objects. The anticipated appearances are combined to create a reasonable video in the future. With this procedure, our method exhibits much less tearing or distortion artifact compared to other approaches. Experimental results on the Cityscapes and KITTI datasets show that our model outperforms the state-of-the-art in terms of visual quality and accuracy.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Video Prediction | Cityscapes | FVS | LPIPS | 0.0850 | #2 of 3 | Archive leaderboard | report |
| Video Prediction | Cityscapes | FVS | MS-SSIM | 0.8910 | #2 of 3 | Archive leaderboard | report |
| Video Prediction | KITTI | FVS | LPIPS | 0.1848 | #2 of 3 | Archive leaderboard | report |
| Video Prediction | KITTI | FVS | MS-SSIM | 0.7928 | #2 of 3 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections