Papers › Implicit Stacked Autoregressive Model for Video Prediction

Implicit Stacked Autoregressive Model for Video Prediction

14 Mar 2023arXiv:2303.07849archive 2025-07-28

Minseok Seo, Hakjin Lee, Doyi Kim, Junghoon Seo

Future frame prediction has been approached through two primary methods: autoregressive and non-autoregressive. Autoregressive methods rely on the Markov assumption and can achieve high accuracy in the early stages of prediction when errors are not yet accumulated. However, their performance tends to decline as the number of time steps increases. In contrast, non-autoregressive methods can achieve relatively high performance but lack correlation between predictions for each time step. In this paper, we propose an Implicit Stacked Autoregressive Model for Video Prediction (IAM4VP), which is an implicit video prediction model that applies a stacked autoregressive method. Like non-autoregressive methods, stacked autoregressive methods use the same observed frame to estimate all future frames. However, they use their own predictions as input, similar to autoregressive methods. As the number of time steps increases, predictions are sequentially stacked in the queue. To evaluate the effectiveness of IAM4VP, we conducted experiments on three common future frame prediction benchmark datasets and weather\&climate prediction benchmark datasets. The results demonstrate that our proposed model achieves state-of-the-art performance.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

PredictionVideo PredictionWeather Forecastingmodel

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Prediction Human3.6M IAM4VP MAE 1120 #1 of 9 Archive leaderboard report
Video Prediction Human3.6M IAM4VP MSE 126 #1 of 9 Archive leaderboard report
Video Prediction Human3.6M IAM4VP SSIM 0.942 #1 of 9 Archive leaderboard report
Video Prediction Moving MNIST IAM4VPx5 MAE 49.2 #3 of 31 Archive leaderboard report
Video Prediction Moving MNIST IAM4VPx5 MSE 15.3 #3 of 31 Archive leaderboard report
Video Prediction Moving MNIST IAM4VPx5 SSIM 0.966 #3 of 31 Archive leaderboard report
Weather Forecasting SEVIR IAM4VP MSE 2.9371 #1 of 8 Archive leaderboard report
Weather Forecasting SEVIR IAM4VP mCSI 0.4607 #1 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections