Lifelong learning

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 173 papers with code (475 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Three scenarios for continual learning
  15 Apr 2019 8 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning difficult for machine learning.
• Learning to Continually Learn
  21 Feb 2020 5 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Continual lifelong learning requires an agent or model to learn many sequentially ordered tasks, building on previous knowledge without catastrophically forgetting it.
• BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning
  17 Feb 2020 5 repositories listed Syntology ran 1 of 3 samples · 2 unverified · 3 pointer-only (licence)
  We also apply BatchEnsemble to lifelong learning, where on Split-CIFAR-100, BatchEnsemble yields comparable performance to progressive neural networks while having a much lower computational and memory costs.
• Generative replay with feedback connections as a general strategy for continual learning
  27 Sep 2018 5 repositories listed
  A major obstacle to developing artificial intelligence applications capable of true lifelong learning is that artificial neural networks quickly or catastrophically forget previously learned tasks when trained on a new…
• Differentiable plasticity: training plastic neural networks with backpropagation
  6 Apr 2018 5 repositories listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  How can we build agents that keep learning from experience, quickly and efficiently, after their initial training?
• Lifelong Reinforcement Learning with Modulating Masks
  21 Dec 2022 4 repositories listed
  The results suggest that RL with modulating masks is a promising approach to lifelong learning, to the composition of knowledge to learn increasingly complex tasks, and to knowledge reuse for efficient and faster…
• Meta-Learning through Hebbian Plasticity in Random Networks
  6 Jul 2020 4 repositories listed
  We find that starting from completely random weights, the discovered Hebbian rules enable an agent to navigate a dynamical 2D-pixel environment; likewise they allow a simulated 3D quadrupedal robot to learn how to walk…
• Lifelong Graph Learning
  1 Sep 2020 3 repositories listed Syntology ran 1 of 4 samples · 3 unverified
  In this paper, we bridge GNN and lifelong learning by converting a continual graph learning problem to a regular graph learning problem so GNN can inherit the lifelong learning techniques developed for convolutional…
• Automatically Optimized Gradient Boosting Trees for Classifying Large Volume High Cardinality Data Streams Under Concept Drift
  30 Nov 2019 3 repositories listed
  Data abundance along with scarcity of machine learning experts and domain specialists necessitates progressive automation of end-to-end machine learning workflows.
• Efficient Lifelong Learning with A-GEM
  2 Dec 2018 3 repositories listed Syntology ran 1 of 12 samples · 11 unverified
  In lifelong learning, the learner is presented with a sequence of tasks, incrementally building a data-driven prior which may be leveraged to speed up learning of a new task.
• Memory Aware Synapses: Learning what (not) to forget
  27 Nov 2017 3 repositories listed Syntology ran 1 of 3 samples · 2 unverified · 1 pointer-only (licence)
  We show state-of-the-art performance and, for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on…
• Lifelong Learning with Dynamically Expandable Networks
  4 Aug 2017 3 repositories listed
  We propose a novel deep network architecture for lifelong learning which we refer to as Dynamically Expandable Network (DEN), that can dynamically decide its network capacity as it trains on a sequence of tasks, to…
• Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters
  18 Mar 2024 2 repositories listed Syntology ran 2 of 4 samples · 2 unverified · 4 pointer-only (licence)
  Continual learning can empower vision-language models to continuously acquire new knowledge, without the need for access to the entire historical dataset.
• Dual Cognitive Architecture: Incorporating Biases and Multi-Memory Systems for Lifelong Learning
  17 Oct 2023 2 repositories listed Syntology ran 1 of 3 samples · 2 unverified
  Artificial neural networks (ANNs) exhibit a narrow scope of expertise on stationary independent data.
• LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning
  5 Jun 2023 2 repositories listed Syntology ran 1 of 6 samples · 5 unverified
  Specifically, LIBERO highlights five key research topics in LLDM: 1) how to efficiently transfer declarative knowledge, procedural knowledge, or the mixture of both; 2) how to design effective policy architectures and…
• Sharing Lifelong Reinforcement Learning Knowledge via Modulating Masks
  18 May 2023 2 repositories listed
  The key idea is that the isolation of specific task knowledge to specific masks allows agents to transfer only specific knowledge on-demand, resulting in robust and effective distributed lifelong learning.
• Continuous Coordination As a Realistic Scenario for Lifelong Learning
  4 Mar 2021 2 repositories listed
  Its large strategy space makes it a desirable environment for lifelong RL tasks.
• How do Quadratic Regularizers Prevent Catastrophic Forgetting: The Role of Interpolation
  4 Feb 2021 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Catastrophic forgetting undermines the effectiveness of deep neural networks (DNNs) in scenarios such as continual learning and lifelong learning.
• Lifelong Policy Gradient Learning of Factored Policies for Faster Training Without Forgetting
  14 Jul 2020 2 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Policy gradient methods have shown success in learning control policies for high-dimensional dynamical systems.
• PODNet: Pooled Outputs Distillation for Small-Tasks Incremental Learning
  28 Apr 2020 2 repositories listed
  Lifelong learning has attracted much attention, but existing works still struggle to fight catastrophic forgetting and accumulate knowledge over long stretches of incremental learning.
• OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning
  15 Nov 2019 2 repositories listed Syntology ran 2 of 5 samples · 3 unverified
  Yet, robotic vision poses unique challenges for applying visual algorithms developed from these standard computer vision datasets due to their implicit assumption over non-varying distributions for a fixed set of tasks.
• Overcoming Forgetting in Federated Learning on Non-IID Data
  17 Oct 2019 2 repositories listed
  Building on an analogy with Lifelong Learning, we adapt a solution for catastrophic forgetting to Federated Learning.
• Compacting, Picking and Growing for Unforgetting Continual Learning
  15 Oct 2019 2 repositories listed Syntology ran 2 of 4 samples · 2 unverified
  First, it can avoid forgetting (i.
• Increasingly Packing Multiple Facial-Informatics Modules in A Unified Deep-Learning Model via Lifelong Learning
  10 Jun 2019 2 repositories listed
  Simultaneously running multiple modules is a key requirement for a smart multimedia system for facial applications including face recognition, facial expression understanding, and gender identification.
• Efficient Forward Architecture Search
  31 May 2019 2 repositories listed
  We propose a neural architecture search (NAS) algorithm, Petridish, to iteratively add shortcut connections to existing network layers.
• Sentence Embedding Alignment for Lifelong Relation Extraction
  6 Mar 2019 2 repositories listed
  We formulate such a challenging problem as lifelong relation extraction and investigate memory-efficient incremental learning methods without catastrophically forgetting knowledge learned from previous tasks.
• HOUDINI: Lifelong Learning as Program Synthesis
  31 Mar 2018 2 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  We present a neurosymbolic framework for the lifelong learning of algorithmic tasks that mix perception and procedural reasoning.
• Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgetting
  8 Feb 2018 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  In this paper we propose an approach to avoiding catastrophic forgetting in sequential task learning scenarios.
• Expert Gate: Lifelong Learning with a Network of Experts
  18 Nov 2016 2 repositories listed
  Further, the autoencoders inherently capture the relatedness of one task to another, based on which the most relevant prior model to be used for training a new expert, with finetuning or learning without-forgetting, can…
• Dynamic Mixture of Progressive Parameter-Efficient Expert Library for Lifelong Robot Learning
  6 Jun 2025 1 repository listed
  A generalist agent must continuously learn and adapt throughout its lifetime, achieving efficient forward transfer while minimizing catastrophic forgetting.

Syntology lines on 16 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.