Papers › Rapid Adaptation with Conditionally Shifted Neurons

Rapid Adaptation with Conditionally Shifted Neurons

28 Dec 2017ICML 2018 7arXiv:1712.09926archive 2025-07-28

Tsendsuren Munkhdalai, Xingdi Yuan, Soroush Mehri, Adam Trischler

We describe a mechanism by which artificial neural networks can learn rapid adaptation - the ability to adapt on the fly, with little data, to new tasks - that we call conditionally shifted neurons. We apply this mechanism in the framework of metalearning, where the aim is to replicate some of the flexibility of human learning in machines. Conditionally shifted neurons modify their activation values with task-specific shifts retrieved from a memory module, which is populated rapidly based on limited task experience. On metalearning benchmarks from the vision and language domains, models augmented with conditionally shifted neurons achieve state-of-the-art results.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Few-Shot Image Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) adaResNet (DF) Accuracy 56.88 #80 of 105 Archive leaderboard report
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) adaResNet (DF) Accuracy 71.94 #76 of 95 Archive leaderboard report
Few-Shot Image Classification OMNIGLOT - 1-Shot, 20-way adaCNN (DF) Accuracy 96.12% #11 of 20 Archive leaderboard report
Few-Shot Image Classification OMNIGLOT - 1-Shot, 5-way adaCNN (DF) Accuracy 98.42 #12 of 17 Archive leaderboard report
Few-Shot Image Classification OMNIGLOT - 5-Shot, 20-way adaCNN (DF) Accuracy 98.43% #14 of 19 Archive leaderboard report
Few-Shot Image Classification OMNIGLOT - 5-Shot, 5-way adaCNN (DF) Accuracy 99.37 #15 of 16 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConvolutionGlobal Average PoolingKaiming InitializationMax PoolingReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections