Datasets › Permuted MNIST

Permuted MNIST

Introduced by Ian J. Goodfellow et al. in An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks1 Jan 2014 archive 2025-07-28

Permuted MNIST is an MNIST variant that consists of 70,000 images of handwritten digits from 0 to 9, where 60,000 images are used for training, and 10,000 images for test. The difference of this dataset from the original MNIST is that each of the ten tasks is the multi-class classification of a different random permutation of the input pixels.

Source: Lifelong Learning with Dynamically Expandable Networks Image Source: https://arxiv.org/pdf/1810.12488.pdf

Benchmarks archive 2025-07-28

All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Continual Learning Permuted MNIST RMN Average Accuracy 97.988 Understanding Catastrophic Forgetting and Remembering in... gitlab.com/prakhark2/relevance-mapping-networks 3 Compare

Papers archive 2025-07-28

3 shown of 3 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 121. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
CODE-CL: Conceptor-Based Gradient Projection for Deep Continual Learning 1 1 21 Nov 2024 not harvested
Model Zoo: A Growing "Brain" That Learns Continually 2 1 6 Jun 2021 ran 0 of 2 samples (2 unverified)
Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping 1 1 22 Feb 2021 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • Permuted MNIST

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections