Papers › Continual Learning with Deep Generative Replay

Continual Learning with Deep Generative Replay

24 May 2017NeurIPS 2017 12arXiv:1705.08690archive 2025-07-28

Hanul Shin, Jung Kwon Lee, Jaehong Kim, Jiwon Kim

Attempts to train a comprehensive artificial intelligence capable of solving multiple tasks have been impeded by a chronic problem called catastrophic forgetting. Although simply replaying all previous data alleviates the problem, it requires large memory and even worse, often infeasible in real world applications where the access to past data is limited. Inspired by the generative nature of hippocampus as a short-term memory system in primate brain, we propose the Deep Generative Replay, a novel framework with a cooperative dual model architecture consisting of a deep generative model ("generator") and a task solving model ("solver"). With only these two models, training data for previous tasks can easily be sampled and interleaved with those for a new task. We test our methods in several sequential learning settings involving image classification tasks.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

epsilon-deltta/ssd_guillotine mentioned on GitHubpytorch report
geox-lab/cmn mentioned on GitHubpytorch report
hursung1/DeepGenerativeReplay mentioned on GitHubpytorch report
kuc2477/pytorch-deep-generative-replay mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Class Incremental LearningContinual LearningGeneral ClassificationImage Classificationclass-incremental learningimage-classification

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Batch NormalizationConvolutionExperience ReplayLayer NormalizationWGAN GPWGAN-GP Loss

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections