Papers › MoCoGAN: Decomposing Motion and Content for Video Generation

MoCoGAN: Decomposing Motion and Content for Video Generation

17 Jul 2017CVPR 2018 6arXiv:1707.04993archive 2025-07-28

Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, Jan Kautz

Visual signals in a video can be divided into content and motion. While content specifies which objects are in the video, motion describes their dynamics. Based on this prior, we propose the Motion and Content decomposed Generative Adversarial Network (MoCoGAN) framework for video generation. The proposed framework generates a video by mapping a sequence of random vectors to a sequence of video frames. Each random vector consists of a content part and a motion part. While the content part is kept fixed, the motion part is realized as a stochastic process. To learn motion and content decomposition in an unsupervised manner, we introduce a novel adversarial learning scheme utilizing both image and video discriminators. Extensive experimental results on several challenging datasets with qualitative and quantitative comparison to the state-of-the-art approaches, verify effectiveness of the proposed framework. In addition, we show that MoCoGAN allows one to generate videos with same content but different motion as well as videos with different content and same motion.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

sergeytulyakov/mocogan officialmentioned in papermentioned on GitHubpytorch report
DLHacks/mocogan mentioned on GitHubpytorch report
HappyBahman/ldvdGAN mentioned on GitHubpytorch report
UBC-Computer-Vision-Group/DwNet mentioned on GitHubpytorchNOASSERTION report
ubc-vision/DwNet mentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Video Generation

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Generation BAIR Robot Pushing MoCoGAN Cond 4 #29 of 31 Archive leaderboard report
Video Generation BAIR Robot Pushing MoCoGAN FVD score 503 #29 of 31 Archive leaderboard report
Video Generation BAIR Robot Pushing MoCoGAN Pred 12 #29 of 31 Archive leaderboard report
Video Generation BAIR Robot Pushing MoCoGAN Train 12 #29 of 31 Archive leaderboard report
Video Generation UCF-101 16 frames, 64x64, Unconditional MoCoGAN Inception Score 12.42 #4 of 7 Archive leaderboard report
Video Generation UCF-101 16 frames, Unconditional, Single GPU MoCoGAN Inception Score 12.42 #4 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections