Papers › Adaptation Strategies for Automated Machine Learning on Evolving Data

Adaptation Strategies for Automated Machine Learning on Evolving Data

9 Jun 2020arXiv:2006.06480archive 2025-07-28

Bilge Celik, Joaquin Vanschoren

Automated Machine Learning (AutoML) systems have been shown to efficiently build good models for new datasets. However, it is often not clear how well they can adapt when the data evolves over time. The main goal of this study is to understand the effect of data stream challenges such as concept drift on the performance of AutoML methods, and which adaptation strategies can be employed to make them more robust. To that end, we propose 6 concept drift adaptation strategies and evaluate their effectiveness on different AutoML approaches. We do this for a variety of AutoML approaches for building machine learning pipelines, including those that leverage Bayesian optimization, genetic programming, and random search with automated stacking. These are evaluated empirically on real-world and synthetic data streams with different types of concept drift. Based on this analysis, we propose ways to develop more sophisticated and robust AutoML techniques.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

openml/continual-automl officialmentioned in paper report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

AutoMLBIG-bench Machine LearningBayesian Optimization

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Random Search

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections