Papers › Iterative Surrogate Model Optimization (ISMO): An active learning algorithm for PDE...

Iterative Surrogate Model Optimization (ISMO): An active learning algorithm for PDE constrained optimization with deep neural networks

13 Aug 2020arXiv:2008.05730archive 2025-07-28

Kjetil O. Lye, Siddhartha Mishra, Deep Ray, Praveen Chandrasekhar

We present a novel active learning algorithm, termed as iterative surrogate model optimization (ISMO), for robust and efficient numerical approximation of PDE constrained optimization problems. This algorithm is based on deep neural networks and its key feature is the iterative selection of training data through a feedback loop between deep neural networks and any underlying standard optimization algorithm. Under suitable hypotheses, we show that the resulting optimizers converge exponentially fast (and with exponentially decaying variance), with respect to increasing number of training samples. Numerical examples for optimal control, parameter identification and shape optimization problems for PDEs are provided to validate the proposed theory and to illustrate that ISMO significantly outperforms a standard deep neural network based surrogate optimization algorithm.

PaperPDFCode

Code

kjetil-lye/ismo_airfoil officialmentioned in papermentioned on GitHub report
kjetil-lye/ismo_heat officialmentioned in papermentioned on GitHub report
kjetil-lye/ismo_validation officialmentioned in papermentioned on GitHub report
kjetil-lye/iterative_surrogate_optimization officialmentioned in papermentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Active LearningModel Optimization

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections